Breast Cancer Detection, Segmentation and Classification on Histopathology Images Analysis: A Systematic Review

Digital pathology represents a major evolution in modern medicine. Pathological examinations constitute the standard in medical protocols and the law, and call for specific action in the diagnostic process. Advances in digital pathology have made it possible for image analysis to take advantage of the information analysis from hematoxylin and eosin stained images. In spite of concern, it is recorded in the majority of breast cancer datasets, which makes research more difficult in prediction. The objective of our work is to evaluate the performance of the machine learning and deep learning techniques applied to predict breast cancer recurrence rates. This study starts with an overview of tissue preparation, analysis of stained images, and a prognosis for cancer patients. The high accuracy results recorded are compromised in terms of sensitivity and specificity. The missing loss function and class imbalance problems are rarely addressed, and most often the chosen performance measures are context-inappropriate. The challenge that presents itself is to analyse whole slide images for the content imaging required with diagnostic biomarkers, and prognosis support backed by digital pathology.

[1]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[2]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[3]  Fritz Albregtsen,et al.  New texture features based on the complexity curve , 1999, Pattern Recognit..

[4]  H. Fox Is H&E morphology coming to an end? , 2000, Journal of clinical pathology.

[5]  F. Bray,et al.  The changing global patterns of female breast cancer incidence and mortality , 2004, Breast Cancer Research.

[6]  Qingmin Liao,et al.  A novel shape prior based segmentation of touching or overlapping ellipse-like nuclei , 2008, SPIE Medical Imaging.

[7]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[8]  Peng Hong,et al.  A Texture Feature Extraction Based on Two Fractal Dimensions for Content Based Image Retrieval , 2009 .

[9]  P Palanisamy,et al.  Complex wavelet based texture features of cancer cytology images , 2010, 2010 5th International Conference on Industrial and Information Systems.

[10]  Chanho Jung,et al.  Unsupervised Segmentation of Overlapped Nuclei Using Bayesian Classification , 2010, IEEE Transactions on Biomedical Engineering.

[11]  Yongming Li,et al.  Two coding based adaptive parallel co-genetic algorithm with double agents structure , 2010, Eng. Appl. Artif. Intell..

[12]  J. Jakić-Razumović,et al.  Morphometry of tumor cells in different grades and types of breast cancer. , 2010, Collegium antropologicum.

[13]  Julian Mattes,et al.  Learning cellular texture features in microscopic cancer cell images for automated cell-detection , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[14]  B. S. Manjunath,et al.  Use of imperfectly segmented nuclei in the classification of histopathology images of breast cancer , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Enrico Macii,et al.  Automated segmentation of tissue images for computerized IHC analysis , 2022 .

[16]  A. Jemal,et al.  Global Patterns of Cancer Incidence and Mortality Rates and Trends , 2010, Cancer Epidemiology, Biomarkers & Prevention.

[17]  John D. Pfeifer,et al.  Review of the current state of whole slide imaging in pathology , 2011, Journal of pathology informatics.

[18]  Metin Nafi Gürcan,et al.  Computerized classification of intraductal breast lesions using histopathological images , 2011, IEEE Transactions on Biomedical Engineering.

[19]  Fritz Albregtsen,et al.  Automatic segmentation of cell nuclei in Feulgen‐stained histological sections of prostate cancer and quantitative evaluation of segmentation results , 2012, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[20]  Ziad M. Abood,et al.  Diagnosis of breast cancer by optical image analysis , 2012 .

[21]  Y. Yagi,et al.  Digital imaging in pathology – current applications and challenges , 2012, Journal of biophotonics.

[22]  B. Yener,et al.  Multiscale Feature Analysis of Salivary Gland Branching Morphogenesis , 2012, PLoS ONE.

[23]  A. Phinyomark,et al.  Texture Analysis of Breast Cancer Cells in Microscopic Images Using Critical Exponent Analysis Method , 2012 .

[24]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[25]  J P Vink,et al.  Efficient nucleus detector in histopathology images , 2013, Journal of microscopy.

[26]  Mitko Veta,et al.  Going fully digital: Perspective of a Dutch academic pathology lab , 2013, Journal of pathology informatics.

[27]  Juan Liu,et al.  Computer-Based Image Studies on Tumor Nests Mathematical Features of Breast Cancer and Their Clinical Prognostic Value , 2013, PloS one.

[28]  S. McKenna,et al.  Immunohistochemical analysis of breast tissue microarray images using contextual classifiers , 2013, Journal of pathology informatics.

[29]  A. Huisman,et al.  Automatic Nuclei Segmentation in H&E Stained Breast Cancer Histopathology Images , 2013, PloS one.

[30]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[31]  Fabian Rudolf,et al.  Accurate cell segmentation in microscopy images using membrane patterns , 2014, Bioinform..

[32]  Max A. Viergever,et al.  Breast Cancer Histopathology Image Analysis: A Review , 2014, IEEE Transactions on Biomedical Engineering.

[33]  Semih Ergin,et al.  A new feature extraction framework based on wavelets for breast cancer diagnosis , 2014, Comput. Biol. Medicine.

[34]  F. Angarita,et al.  Perioperative measures to optimize margin clearance in breast conserving surgery. , 2014, Surgical oncology.

[35]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[36]  Farhat Fnaiech,et al.  Color edges extraction using statistical features and automatic threshold technique: application to the breast cancer cells , 2014, Biomedical engineering online.

[37]  Rong Jin,et al.  Online Feature Selection and Its Applications , 2014, IEEE Transactions on Knowledge and Data Engineering.

[38]  Murat Karabatak,et al.  A new classifier for breast cancer detection based on Naïve Bayesian , 2015 .

[39]  Hassan Ghassemian,et al.  Automated mitosis detection based on combination of effective textural and morphological features from breast cancer histology slide images , 2015, 2015 22nd Iranian Conference on Biomedical Engineering (ICBME).

[40]  Sheetal Shahari,et al.  Color analysis of thermograms for breast cancer detection , 2015, 2015 International Conference on Industrial Instrumentation and Control (ICIC).

[41]  Adel Al-Jumaily,et al.  Semi Advised SVM with Adaptive Differential Evolution Based Feature Selection for Skin Cancer Diagnosis , 2015 .

[42]  Aruna Tiwari,et al.  Breast cancer diagnosis using Genetically Optimized Neural Network model , 2015, Expert Syst. Appl..

[43]  Hai Su,et al.  Robust Cell Detection and Segmentation in Histopathological Images Using Sparse Reconstruction and Stacked Denoising Autoencoders , 2015, MICCAI.

[44]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Nico Karssemeijer,et al.  A multi-scale superpixel classification approach to the detection of regions of interest in whole slide histopathology images , 2015, Medical Imaging.

[46]  Francesco Bianconi,et al.  Dominant local binary patterns for texture classification: Labelled or unlabelled? , 2015, Pattern Recognit. Lett..

[47]  Bai Ying Lei,et al.  Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning , 2015, IEEE Transactions on Biomedical Engineering.

[48]  Dimitrios I. Fotiadis,et al.  Machine learning applications in cancer prognosis and prediction , 2014, Computational and structural biotechnology journal.

[49]  Kesari Verma,et al.  Investigations on Impact of Feature Normalization Techniques on Classifier's Performance in Breast Tumor Classification , 2015 .

[50]  J. Tang,et al.  A Fuzzy-C-Means-Clustering Approach: Quantifying Chromatin Pattern of Non-Neoplastic Cervical Squamous Cells , 2015, PloS one.

[51]  Neeraj Kumar,et al.  Empirical comparison of color normalization methods for epithelial-stromal classification in H and E images , 2016, Journal of pathology informatics.

[52]  Aruna Tiwari,et al.  A genetically optimized neural network model for multi-class classification , 2016, Expert Syst. Appl..

[53]  P. Sukumar,et al.  Computer Aided Detection of Cervical Cancer Using Pap Smear Images Based on Adaptive Neuro Fuzzy Inference System Classifier , 2016 .

[54]  A. Madabhushi,et al.  Automated Tubule Nuclei Quantification and Correlation with Oncotype DX risk categories in ER+ Breast Cancer Whole Slide Images , 2016, Scientific reports.

[55]  Hoo-Chang Hoo-Chang Shin Shin,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, Ieee Transactions on Medical Imaging.

[56]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Transactions on Medical Imaging.

[57]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[58]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[59]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[60]  Nasir M. Rajpoot,et al.  Handcrafted features with convolutional neural networks for detection of tumor cells in histology images , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[61]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of breast cancer histopathology images , 2016, Signal Process..

[62]  Hao Chen,et al.  Mitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks , 2016, AAAI.

[63]  Claudio E. Torres,et al.  Segmentation of HER2 protein overexpression in immunohistochemically stained breast cancer images using Support Vector Machines , 2016 .

[64]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[65]  Lin Yang,et al.  An Automatic Learning-Based Framework for Robust Nucleus Segmentation , 2016, IEEE Transactions on Medical Imaging.

[66]  Mitko Veta,et al.  Cutting Out the Middleman: Measuring Nuclear Area in Histopathology Slides Without Segmentation , 2016, MICCAI.

[67]  Xudong Jiang,et al.  Accurate Cervical Cell Segmentation from Overlapping Clumps in Pap Smear Images , 2017, IEEE Trans. Medical Imaging.

[68]  T. A. A. Tosta,et al.  Segmentation methods of H&E-stained histological images of lymphoma: A review , 2017 .

[69]  Zhang Yi,et al.  Breast cancer cell nuclei classification in histopathology images using deep neural networks , 2018, International Journal of Computer Assisted Radiology and Surgery.

[70]  Andrew Janowczyk,et al.  Stain Normalization using Sparse AutoEncoders (StaNoSA): Application to digital pathology , 2017, Comput. Medical Imaging Graph..

[71]  C. Chakraborty,et al.  An Advanced Deep Learning Approach for Ki-67 Stained Hotspot Detection and Proliferation Rate Scoring for Prognostic Evaluation of Breast Cancer , 2017, Scientific Reports.

[72]  Zhenbing Liu,et al.  Cell detection in pathology and microscopy images with multi-scale fully convolutional neural networks , 2018, World Wide Web.

[73]  Roshan Joy Martis,et al.  Asymmetry analysis of breast thermograms using automated segmentation and texture features , 2017, Signal Image Video Process..

[74]  Yuanjie Zheng,et al.  Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model , 2017, Scientific Reports.

[75]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[76]  Jie-Zhi Cheng,et al.  Accurate Cervical Cell Segmentation from Overlapping Clumps in Pap Smear Images , 2017, IEEE Transactions on Medical Imaging.

[77]  Thomas Walter,et al.  Nuclei segmentation in histopathology images using deep neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[78]  Abdulkader Helwan,et al.  Breast cancer image classification using artificial neural networks , 2017 .

[79]  Minsoo Kim,et al.  A Unified Framework for Tumor Proliferation Score Prediction in Breast Histopathology , 2016, DLMIA/ML-CDS@MICCAI.

[80]  Luiz Eduardo Soares de Oliveira,et al.  Deep features for breast cancer histopathological image classification , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[81]  Hao Chen,et al.  3D deeply supervised network for automated segmentation of volumetric medical images , 2017, Medical Image Anal..

[82]  Zhipeng Jia,et al.  Constrained Deep Weak Supervision for Histopathology Image Segmentation , 2017, IEEE Transactions on Medical Imaging.

[83]  Zhenbing Liu,et al.  Accurate segmentation of nuclei in pathological images via sparse reconstruction and deep convolutional networks , 2017, Neurocomputing.

[84]  Elena Casiraghi,et al.  A novel computational method for automatic segmentation, quantification and comparative analysis of immunohistochemically labeled tissue sections , 2018, BMC Bioinformatics.

[85]  Gokhan Bilgin,et al.  Automatic cell segmentation in histopathological images via two-staged superpixel-based algorithms , 2018, Medical & Biological Engineering & Computing.

[86]  Andrew Janowczyk,et al.  A resolution adaptive deep hierarchical (RADHicaL) learning scheme applied to nuclear segmentation of digital pathology images , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[87]  Bayram Akdemir,et al.  A convolutional neural network model for semantic segmentation of mitotic events in microscopy images , 2018, Neural Computing and Applications.

[88]  Alice Porebski,et al.  Unsupervised Local Binary Pattern Histogram Selection Scores for Color Texture Classification , 2018, J. Imaging.

[89]  J. Milovanović,et al.  Effects of different preprocessing algorithms on the prognostic value of breast tumour microscopic images , 2018, Journal of microscopy.

[90]  Filiz Bunyak,et al.  Improving Nuclei Classification Performance in H&E Stained Tissue Images Using Fully Convolutional Regression Network and Convolutional Neural Network , 2018, 2018 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[91]  C. Selvi,et al.  A Novel Enhanced Gray Scale Adaptive Method for Prediction of Breast Cancer , 2018, Journal of Medical Systems.

[92]  Hang Chang,et al.  Unsupervised Transfer Learning via Multi-Scale Convolutional Sparse Coding for Biomedical Applications , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  Chao-Hui Huang,et al.  eXclusive Autoencoder (XAE) for Nucleus Detection and Classification on Hematoxylin and Eosin (H&E) Stained Histopathological Images , 2018, ArXiv.

[94]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[95]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[96]  Joel J. P. C. Rodrigues,et al.  A novel deep learning based framework for the detection and classification of breast cancer using transfer learning , 2019, Pattern Recognit. Lett..

[97]  Hao Chen,et al.  A Survey for Breast Histopathology Image Analysis Using Classical and Deep Neural Networks , 2019, ITIB.

[98]  Mita Nasipuri,et al.  Patch-based system for Classification of Breast Histology images using deep learning , 2019, Comput. Medical Imaging Graph..

[99]  Luiz Eduardo Soares de Oliveira,et al.  Multiple instance learning for histopathological breast cancer image classification , 2019, Expert Syst. Appl..

[100]  Leyun Pan,et al.  Multi-Path Dilated Residual Network for Nuclei Segmentation and Detection , 2019, Cells.

[101]  Janet Roveda,et al.  Cell Nuclei Detection and Segmentation for Computational Pathology Using Deep Learning , 2019, 2019 Spring Simulation Conference (SpringSim).

[102]  Joel H. Saltz,et al.  Sparse Autoencoder for Unsupervised Nucleus Detection and Representation in Histopathology Images , 2017, Pattern Recognit..

[103]  Mahmoud Abdolhoseini,et al.  Segmentation of Heavily Clustered Nuclei from Histopathological Images , 2019, Scientific Reports.

[104]  Pranab Kumar Dutta,et al.  Efficient automated detection of mitotic cells from breast histological images using deep convolution neutral network with wavelet decomposed patches , 2019, Comput. Biol. Medicine.

[105]  Daisuke Komura,et al.  Machine learning approaches for pathologic diagnosis , 2019, Virchows Archiv.

[106]  Sang-Woong Lee,et al.  Classification of breast cancer histology images using incremental boosting convolution networks , 2019, Inf. Sci..