Computer-Aided Histopathological Image Analysis Techniques for Automated Nuclear Atypia Scoring of Breast Cancer: a Review

Breast cancer is the most common type of malignancy diagnosed in women. Through early detection and diagnosis, there is a great chance of recovery and thereby reduce the mortality rate. Many preliminary tests like non-invasive radiological diagnosis using ultrasound, mammography, and MRI are widely used for the diagnosis of breast cancer. However, histopathological analysis of breast biopsy specimen is inevitable and is considered to be the golden standard for the affirmation of cancer. With the advancements in the digital computing capabilities, memory capacity, and imaging modalities, the development of computer-aided powerful analytical techniques for histopathological data has increased dramatically. These automated techniques help to alleviate the laborious work of the pathologist and to improve the reproducibility and reliability of the interpretation. This paper reviews and summarizes digital image computational algorithms applied on histopathological breast cancer images for nuclear atypia scoring and explores the future possibilities. The algorithms for nuclear pleomorphism scoring of breast cancer can be widely grouped into two categories: handcrafted feature-based and learned feature-based. Handcrafted feature-based algorithms mainly include the computational steps like pre-processing the images, segmenting the nuclei, extracting unique features, feature selection, and machine learning–based classification. However, most of the recent algorithms are based on learned features, that extract high-level abstractions directly from the histopathological images utilizing deep learning techniques. In this paper, we discuss the various algorithms applied for the nuclear pleomorphism scoring of breast cancer, discourse the challenges to be dealt with, and outline the importance of benchmark datasets. A comparative analysis of some prominent works on breast cancer nuclear atypia scoring is done using a benchmark dataset which enables to quantitatively measure and compare the different features and algorithms used for breast cancer grading. Results show that improvements are still required, to have an automated cancer grading system suitable for clinical applications.

[1]  B Asselain,et al.  Comparison of the prognostic value of Scarff-Bloom-Richardson and Nottingham histological grades in a series of 825 cases of breast cancer: major importance of the mitotic count as a component of both grading systems. , 1998, Anticancer research.

[2]  Eduardo Romero,et al.  A Grading Strategy for Nuclear Pleomorphism in Histopathological Breast Cancer Images Using a Bag of Features (BOF) , 2015, CIARP.

[3]  Andrew Evans,et al.  Digital imaging in pathology: whole-slide imaging and beyond. , 2013, Annual review of pathology.

[4]  Anant Madabhushi,et al.  Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  B Weyn,et al.  Automated breast tumor diagnosis and grading based on wavelet chromatin texture description. , 1998, Cytometry.

[6]  Robinson Thamburaj,et al.  Automated Nuclear Pleomorphism Scoring in Breast Cancer Histopathology Images Using Deep Neural Networks , 2015, MIKE.

[7]  Lilly Suriani Affendey,et al.  Classification of Histopathology Images of Breast into Benign and Malignant using a Single-layer Convolutional Neural Network , 2017, ICISPC 2017.

[8]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[9]  Ziba Gandomkar,et al.  MuDeRN: Multi-category classification of breast histopathological image using deep residual networks , 2018, Artif. Intell. Medicine.

[10]  J. Elmore,et al.  Diagnostic concordance among pathologists interpreting breast biopsy specimens. , 2015, JAMA.

[11]  A. P. De Leenheer,et al.  Standardization of reagents and methods used in cytological and histological practice with emphasis on dyes, stains and chromogenic reagents , 1994, The Histochemical Journal.

[12]  Anthony Rhodes,et al.  American Society of Clinical Oncology/College of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer (unabridged version). , 2010, Archives of pathology & laboratory medicine.

[13]  Bing Lang,et al.  Deep Learning for Histopathological Image Analysis: Towards Computerized Diagnosis on Cancers , 2017, Deep Learning and Convolutional Neural Networks for Medical Image Computing.

[14]  Alexander Rakhlin,et al.  Deep Convolutional Neural Networks for Breast Cancer Histology Image Analysis , 2018, bioRxiv.

[15]  Nasir M. Rajpoot,et al.  A Global Covariance Descriptor for Nuclear Atypia Scoring in Breast Histopathology Images , 2015, IEEE Journal of Biomedical and Health Informatics.

[16]  Andreas K. Maier,et al.  Classification of breast cancer histology images using transfer learning , 2018, ICIAR.

[17]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[18]  Yinan Kong,et al.  Histopathological Breast Cancer Image Classification by Deep Neural Network Techniques Guided by Local Clustering , 2018, BioMed research international.

[19]  Amit Sethi,et al.  Classification of Breast Cancer Histology using Deep Learning , 2018, ICIAR.

[20]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[21]  R. Kumar,et al.  Detection and Classification of Cancer from Microscopic Biopsy Images Using Clinically Significant and Biologically Interpretable Features , 2015, Journal of medical engineering.

[22]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[23]  Manfredo Atzori,et al.  Chapter 10 – Analysis of Histopathology Images: From Traditional Machine Learning to Deep Learning , 2017 .

[24]  Zhen Ma,et al.  Automated image analysis of nuclear atypia in high‐power field histopathological image , 2015, Journal of microscopy.

[25]  O L Mangasarian,et al.  Computer-derived nuclear "grade" and breast cancer prognosis. , 1995, Analytical and quantitative cytology and histology.

[26]  Vijayan K. Asari,et al.  Breast Cancer Classification from Histopathological Images with Inception Recurrent Residual Convolutional Neural Network , 2018, Journal of Digital Imaging.

[27]  Khurram Khurshid,et al.  Classification of Breast Cancer Histology Images Using Transfer Learning , 2019, 2019 16th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[28]  Matti Pietikäinen,et al.  Automated classification of breast cancer morphology in histopathological images , 2013, Diagnostic Pathology.

[29]  Xiaohui Xie,et al.  Deep Learning Framework for Multi-class Breast Cancer Histology Image Classification , 2018, ICIAR.

[30]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[31]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[32]  Michael Stierer,et al.  Nuclear pleomorphism, a strong prognostic factor in axillary node-negative small invasive breast cancer , 1991, Breast Cancer Research and Treatment.

[33]  Nicolas Loménie,et al.  Time-efficient sparse analysis of histopathological whole slide images , 2011, Comput. Medical Imaging Graph..

[34]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[35]  Andreas Kårsnäs,et al.  Image Analysis Methods and Tools for Digital Histopathology Applications Relevant to Breast Cancer Diagnosis , 2014 .

[36]  W. Leow,et al.  Automatic breast cancer grading of histopathological images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Maria S. Kulikova,et al.  Mitosis detection in breast cancer histological images An ICPR 2012 contest , 2013, Journal of pathology informatics.

[38]  Jun Liu,et al.  Breast Cancer Histology Image Classification Based on Deep Neural Networks , 2018, ICIAR.

[39]  Yilong Yin,et al.  Deep learning model based breast cancer histopathological image classification , 2017, 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).

[40]  J. S. Marron,et al.  Appearance Normalization of Histology Slides , 2010, MLMI.

[41]  Kun Zhang,et al.  Classification of Breast Cancer Based on Histology Images Using Convolutional Neural Networks , 2018, IEEE Access.

[42]  Madhu S. Nair,et al.  Automatic segmentation of cell nuclei using Krill Herd optimization based multi-thresholding and Localized Active Contour Model , 2016 .

[43]  David Parham,et al.  The Problems and Promise of Central Pathology Review: Development of a Standardized Procedure for the Children's Oncology Group , 2007, Pediatric and developmental pathology : the official journal of the Society for Pediatric Pathology and the Paediatric Pathology Society.

[44]  Constantine Katsinis,et al.  Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer , 2006, BMC Medical Imaging.

[45]  Uma S. Dubey,et al.  Epidemiology of breast cancer in Indian women , 2017, Asia-Pacific journal of clinical oncology.

[46]  Anant Madabhushi,et al.  Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[47]  Dan J Stein,et al.  Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013 , 2015, BDJ.

[48]  D. Demetrick,et al.  BreCaHAD: a dataset for breast cancer histopathological annotation and diagnosis , 2019, BMC Research Notes.

[49]  Anthony Rhodes,et al.  American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. , 2006, Archives of pathology & laboratory medicine.

[50]  Constantine Katsinis,et al.  Automated identification of microstructures on histology slides , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[51]  E. Valuations.  A REVIEW ON EVALUATION METRICS FOR DATA CLASSIFICATION EVALUATIONS , 2015 .

[52]  Juho Kannala,et al.  Deep learning for magnification independent breast cancer histopathology image classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[53]  Yuanjie Zheng,et al.  Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model , 2017, Scientific Reports.

[54]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[55]  Luiz Eduardo Soares de Oliveira,et al.  Deep features for breast cancer histopathological image classification , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[56]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[57]  Anant Madabhushi,et al.  Multi-Field-of-View Framework for Distinguishing Tumor Grade in ER+ Breast Cancer From Entire Histopathology Slides , 2013, IEEE Transactions on Biomedical Engineering.

[58]  Yun Jiang,et al.  Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module , 2019, PloS one.

[59]  Ali Jaoua,et al.  Breast cancer image classification using pattern-based Hyper Conceptual Sampling method , 2018 .

[60]  S Friedman,et al.  The importance of histologic grade in long-term prognosis of breast cancer: a study of 1,010 patients, uniformly treated at the Institut Gustave-Roussy. , 1987, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[61]  Mitko Veta,et al.  Prognostic value of automatically extracted nuclear morphometric features in whole slide images of male breast cancer , 2012, Modern Pathology.

[62]  Chao-Hui Huang,et al.  Nuclear pleomorphism scoring by selective cell nuclei detection , 2009, WACV.

[63]  Dan J Stein,et al.  Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013 , 2015, BDJ.

[64]  Madhu S. Nair,et al.  Sparse Representation Over Learned Dictionaries on the Riemannian Manifold for Automated Grading of Nuclear Pleomorphism in Breast Cancer , 2019, IEEE Transactions on Image Processing.

[65]  Nico Karssemeijer,et al.  Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images , 2017, Journal of medical imaging.

[66]  John Meyer,et al.  Grading nuclear pleomorphism on histological micrographs , 2008, 2008 19th International Conference on Pattern Recognition.

[67]  Iman Hajirasouliha,et al.  Breast Cancer Histopathological Image Classification: A Deep Learning Approach , 2018, bioRxiv.

[68]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[69]  J. S. Marron,et al.  Appearance Normalization of Histology Slides , 2010, MLMI.

[70]  Jianhui Chen,et al.  Automated grading of breast cancer histopathology using cascaded ensemble with combination of multi-level image features , 2017, Neurocomputing.

[71]  Luca Maria Gambardella,et al.  Assessment of algorithms for mitosis detection in breast cancer histopathology images , 2014, Medical Image Anal..

[72]  A. Ruifrok,et al.  Comparison of Quantification of Histochemical Staining By Hue-Saturation-Intensity (HSI) Transformation and Color-Deconvolution , 2003, Applied immunohistochemistry & molecular morphology : AIMM.

[73]  Karl Rohr,et al.  Automatic breast cancer grading in lymph nodes using a deep neural network , 2017, ArXiv.

[74]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[75]  Mohammad Sadegh Helfroush,et al.  Cancerous Nuclei Detection and Scoring in Breast Cancer Histopathological Images , 2016, ArXiv.

[76]  C. Osborne,et al.  Diseases of the breast: Fifth edition , 2014 .

[77]  Ziba Gandomkar,et al.  Computer-Assisted Nuclear Atypia Scoring of Breast Cancer: a Preliminary Study , 2019, Journal of Digital Imaging.

[78]  Hadi Rezaeilouyeh,et al.  Microscopic medical image classification framework via deep learning and shearlet transform , 2016, Journal of medical imaging.

[79]  Anthony Rhodes,et al.  American Society of Clinical Oncology/College of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer. , 2010, Archives of pathology & laboratory medicine.