Efficient deep learning model for mitosis detection using breast histopathology images

Mitosis detection is one of the critical factors of cancer prognosis, carrying significant diagnostic information required for breast cancer grading. It provides vital clues to estimate the aggressiveness and the proliferation rate of the tumour. The manual mitosis quantification from whole slide images is a very labor-intensive and challenging task. The aim of this study is to propose a supervised model to detect mitosis signature from breast histopathology WSI images. The model has been designed using deep learning architecture with handcrafted features. We used handcrafted features issued from previous medical challenges MITOS @ ICPR 2012, AMIDA-13 and projects (MICO ANR TecSan) expertise. The deep learning architecture mainly consists of five convolution layers, four max-pooling layers, four rectified linear units (ReLU), and two fully connected layers. ReLU has been used after each convolution layer as an activation function. Dropout layer has been included after first fully connected layer to avoid overfitting. Handcrafted features mainly consist of morphological, textural and intensity features. The proposed architecture has shown to have an improved 92% precision, 88% recall and 90% F-score. Prospectively, the proposed model will be very beneficial in routine exam, providing pathologists with efficient and - as we will prove - effective second opinion for breast cancer grading from whole slide images. Last but not the least, this model could lead junior and senior pathologists, as medical researchers, to a superior understanding and evaluation of breast cancer stage and genesis.

[1]  Stephen Fox,et al.  HER3 and downstream pathways are involved in colonization of brain metastases from breast cancer , 2010, Breast Cancer Research.

[2]  Maria S. Kulikova,et al.  Mitosis detection in breast cancer histological images An ICPR 2012 contest , 2013, Journal of pathology informatics.

[3]  Huai Li,et al.  Artificial convolution neural network for medical image pattern recognition , 1995, Neural Networks.

[4]  J. Dick,et al.  A human colon cancer cell capable of initiating tumour growth in immunodeficient mice , 2007, Nature.

[5]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Bahram Parvin,et al.  NUCLEAR SEGMENTATION IN H & E SECTIONS VIA MULTI-REFERENCE GRAPH CUT ( MRGC ) , 2011 .

[7]  Chandan Chakraborty,et al.  Texture based segmentation of epithelial layer from oral histological images. , 2011, Micron.

[8]  Olaf Hellwich,et al.  A review of graph-based methods for image analysis in digital histopathology , 2015 .

[9]  Charles Y. Tao,et al.  A Support Vector Machine Classifier for Recognizing Mitotic Subphases Using High-Content Screening Data , 2007, Journal of biomolecular screening.

[10]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[11]  Shu Ichihara,et al.  Breast cancer prognostic classification in the molecular era: the role of histological grade , 2010, Breast Cancer Research.

[12]  Oscar C. Au,et al.  2-SiMDoM: A 2-Sieve model for detection of mitosis in multispectral breast cancer imagery , 2013, 2013 IEEE International Conference on Image Processing.

[13]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[14]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[15]  Habibollah Danyali,et al.  Automatic detection of mitosis cell in breast cancer histopathology images using genetic algorithm , 2014, 2014 21th Iranian Conference on Biomedical Engineering (ICBME).

[16]  R. Lazzarini,et al.  Synthesis of viral mRNA and polyadenylate by a ribonucleoprotein complex from extracts of VSV-infected cells. , 1974, Cell.

[17]  Nicolas Courty,et al.  Mitosis detection in breast cancer histological images with mathematical morphology , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[18]  Mohammad Sadegh Helfroush,et al.  A Novel CAD System for Mitosis detection Using Histopathology Slide Images , 2014, Journal of medical signals and sensors.

[19]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[20]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[21]  C. Chakraborty,et al.  An Advanced Deep Learning Approach for Ki-67 Stained Hotspot Detection and Proliferation Rate Scoring for Prognostic Evaluation of Breast Cancer , 2017, Scientific Reports.

[22]  Humayun Irshad,et al.  Automated mitosis detection using texture, SIFT features and HMAX biologically inspired approach , 2013, Journal of pathology informatics.

[23]  Christel Daniel,et al.  A sustainable visual representation of available histopathological digital knowledge for breast cancer grading , 2016 .

[24]  Fabio A. González,et al.  Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection , 2014, Medical Imaging.

[25]  Abderrahim Elmoataz,et al.  Multi-resolution graph-based analysis of histopathological whole slide images: Application to mitotic cell extraction and visualization , 2011, Comput. Medical Imaging Graph..

[26]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[27]  Takeo Kanade,et al.  Mitosis sequence detection using hidden conditional random fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  Chao-Hui Huang,et al.  Automated mitosis detection based on eXclusive Independent Component Analysis , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[29]  C. Chakraborty,et al.  Computer-aided diagnosis of breast cancer using cytological images: A systematic review. , 2016, Tissue & cell.

[30]  Chandan Chakraborty,et al.  Computer Vision Approach to Morphometric Feature Analysis of Basal Cell Nuclei for Evaluating Malignant Potentiality of Oral Submucous Fibrosis , 2012, Journal of Medical Systems.

[31]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Nassir Navab,et al.  AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[33]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[34]  Hans Burkhardt,et al.  Harmonic Filters for 3D Multichannel Data: Rotation Invariant Detection of Mitoses in Colorectal Cancer , 2010, IEEE Transactions on Medical Imaging.

[35]  Daniel Racoceanu,et al.  Multispectral band selection and spatial characterization: Application to mitosis detection in breast cancer histopathology , 2014, Comput. Medical Imaging Graph..

[36]  Mohammad Sadegh Helfroush,et al.  An automatic mitosis detection method for breast cancer histopathology slide images based on objective and pixel-wise textural features classification , 2013, The 5th Conference on Information and Knowledge Technology.

[37]  Luca Maria Gambardella,et al.  Assessment of algorithms for mitosis detection in breast cancer histopathology images , 2014, Medical Image Anal..

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[39]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[40]  H. Irshad Automated mitosis detection in histopathology using morphological and multi-channel statistics features , 2013, Journal of pathology informatics.

[41]  Mitko Veta,et al.  Mitosis Counting in Breast Cancer: Object-Level Interobserver Agreement and Comparison to an Automatic Method , 2016, PloS one.

[42]  Takeo Kanade,et al.  Automated Mitosis Detection of Stem Cell Populations in Phase-Contrast Microscopy Images , 2011, IEEE Transactions on Medical Imaging.

[43]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[44]  Gokhan Bilgin,et al.  Mitosis detection on histopathological images using statistical detection algorithms , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[45]  Dipti Prasad Mukherjee,et al.  Mitosis Detection for Invasive Breast Cancer Grading in Histopathological Images , 2015, IEEE Transactions on Image Processing.

[46]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. , 1999, Critical reviews in oncology/hematology.

[47]  Angel Cruz-Roa,et al.  Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features , 2014, Journal of medical imaging.

[48]  Daniel Racoceanu,et al.  Spectral band selection for mitosis detection in histopathology , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[49]  G. Kayser,et al.  How to analyze Structure and Function in Tissue – based Diagnosis? , 2016 .

[50]  Chandan Chakraborty,et al.  Quantitative microscopic evaluation of mucin areas and its percentage in mucinous carcinoma of the breast using tissue histological images. , 2016, Tissue & cell.

[52]  R. Pollack,et al.  Cancer biology. , 1978, Science.

[53]  F. Boray Tek,et al.  Mitosis detection using generic features and an ensemble of cascade adaboosts , 2013, Journal of pathology informatics.

[54]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[55]  Eric Cosatto,et al.  Classification of mitotic figures with convolutional neural networks and seeded blob features , 2013, Journal of pathology informatics.

[56]  Shadi Albarqouni,et al.  AggNet : Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images , 2016 .

[57]  Pabitra Mitra,et al.  Histogram Based Thresholding for Automated Nucleus Segmentation Using Breast Imprint Cytology , 2015 .

[58]  Akira Saito,et al.  Mitotic Figure Recognition: Agreement among Pathologists and Computerized Detector , 2011, Analytical cellular pathology.

[59]  Luca Maria Gambardella,et al.  A comparison of algorithms and humans for mitosis detection , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[60]  D. Mazia,et al.  Mitosis and the Physiology of Cell Division , 1961 .