Role of AI and Histopathological Images in Detecting Prostate Cancer: A Survey

Prostate cancer is one of the most identified cancers and second most prevalent among cancer-related deaths of men worldwide. Early diagnosis and treatment are substantial to stop or handle the increase and spread of cancer cells in the body. Histopathological image diagnosis is a gold standard for detecting prostate cancer as it has different visual characteristics but interpreting those type of images needs a high level of expertise and takes too much time. One of the ways to accelerate such an analysis is by employing artificial intelligence (AI) through the use of computer-aided diagnosis (CAD) systems. The recent developments in artificial intelligence along with its sub-fields of conventional machine learning and deep learning provide new insights to clinicians and researchers, and an abundance of research is presented specifically for histopathology images tailored for prostate cancer. However, there is a lack of comprehensive surveys that focus on prostate cancer using histopathology images. In this paper, we provide a very comprehensive review of most, if not all, studies that handled the prostate cancer diagnosis using histopathological images. The survey begins with an overview of histopathological image preparation and its challenges. We also briefly review the computing techniques that are commonly applied in image processing, segmentation, feature selection, and classification that can help in detecting prostate malignancies in histopathological images.

[1]  Fritz Albregtsen,et al.  Automatic segmentation of cell nuclei in Feulgen‐stained histological sections of prostate cancer and quantitative evaluation of segmentation results , 2012, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[2]  Haibo Wang,et al.  Supervised Multi-View Canonical Correlation Analysis (sMVCCA): Integrating Histologic and Proteomic Features for Predicting Recurrent Prostate Cancer , 2015, IEEE Transactions on Medical Imaging.

[3]  Manfred Claassen,et al.  Coupling weak and strong supervision for classification of prostate cancer histopathology images , 2018, ArXiv.

[4]  Anil K. Jain,et al.  Prostate cancer grading: Gland segmentation and structural features , 2012, Pattern Recognit. Lett..

[5]  Ahmed I. Saleh,et al.  A new COVID-19 Patients Detection Strategy (CPDS) based on hybrid feature selection and enhanced KNN classifier , 2020, Knowledge-Based Systems.

[6]  Konstantinos N. Plataniotis,et al.  A Complete Color Normalization Approach to Histopathology Images Using Color Cues Computed From Saturation-Weighted Statistics , 2015, IEEE Transactions on Biomedical Engineering.

[7]  M. A. Aswathy,et al.  Detection of breast cancer on digital histopathology images: Present status and future possibilities , 2017 .

[8]  Lucas C Cahill,et al.  Comparing histologic evaluation of prostate tissue using nonlinear microscopy and paraffin H&E: a pilot study , 2019, Modern Pathology.

[9]  Alessandro Lameiras Koerich,et al.  Data Augmentation for Histopathological Images Based on Gaussian-Laplacian Pyramid Blending , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[10]  Derek J. Van Booven,et al.  A Systematic Review of Artificial Intelligence in Prostate Cancer , 2021, Research and reports in urology.

[11]  Kaushal K. Shukla,et al.  Classification of Histopathological images of Breast Cancerous and Non Cancerous Cells Based on Morphological features , 2017 .

[12]  Santiago Velasco-Forero,et al.  A New Color Augmentation Method for Deep Learning Segmentation of Histological Images , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[13]  Ning Xu,et al.  A review for cervical histopathology image analysis using machine vision approaches , 2020, Artificial Intelligence Review.

[14]  Ahmed I. Saleh,et al.  Gene expression cancer classification using modified K-Nearest Neighbors technique , 2019, Biosyst..

[15]  Suet-Peng Yong,et al.  A comparison of deep learning and hand crafted features in medical image modality classification , 2016, 2016 3rd International Conference on Computer and Information Sciences (ICCOINS).

[16]  Claus Bahlmann,et al.  Computer-aided gleason grading of prostate cancer histopathological images using texton forests , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  Krishna Singh,et al.  A Review on Conventional Machine Learning vs Deep Learning , 2018, 2018 International Conference on Computing, Power and Communication Technologies (GUCON).

[18]  Sos Agaian,et al.  Computer-Aided Prostate Cancer Diagnosis From Digitized Histopathology: A Review on Texture-Based Systems , 2015, IEEE Reviews in Biomedical Engineering.

[19]  Hammad Qureshi,et al.  Translational AI and Deep Learning in Diagnostic Pathology , 2019, Front. Med..

[20]  M. Khalid Khan,et al.  Visually Meaningful Histopathological Features for Automatic Grading of Prostate Cancer , 2017, IEEE Journal of Biomedical and Health Informatics.

[21]  Anant Madabhushi,et al.  A Boosting Cascade for Automated Detection of Prostate Cancer from Digitized Histology , 2006, MICCAI.

[22]  Shahnorbanun Sahran,et al.  A HIERARCHICAL CLASSIFIER FOR MULTICLASS PROSTATE HISTOPATHOLOGY IMAGE GLEASON GRADING , 2018 .

[23]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[24]  Jeffrey L. Gunter,et al.  Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks , 2018, SASHIMI@MICCAI.

[25]  Adrián Colomer,et al.  First-Stage Prostate Cancer Identification on Histopathological Images: Hand-Driven versus Automatic Learning , 2019, Entropy.

[26]  Sos S. Agaian,et al.  Exploration of efficacy of gland morphology and architectural features in prostate cancer gleason grading , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[27]  Milind M. Mushrif,et al.  HISTOPATHOLOGICAL IMAGE ANALYSIS USING IMAGE PROCESSING TECHNIQUES : AN OVERVIEW , 2012 .

[28]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[29]  Max A. Viergever,et al.  Breast Cancer Histopathology Image Analysis: A Review , 2014, IEEE Transactions on Biomedical Engineering.

[30]  Ying Wang,et al.  Breast cancer histopathology image classification through assembling multiple compact CNNs , 2019, BMC Medical Informatics and Decision Making.

[31]  Yukako Yagi,et al.  Color standardization in whole slide imaging using a color calibration slide , 2014, Journal of pathology informatics.

[32]  Ayman El-Baz,et al.  Deep Learning Role in Early Diagnosis of Prostate Cancer , 2018, Technology in cancer research & treatment.

[33]  Yuxin Cui,et al.  A deep learning algorithm for one-step contour aware nuclei segmentation of histopathology images , 2018, Medical & Biological Engineering & Computing.

[34]  Claes Lundström,et al.  Towards grading gleason score using generically trained deep convolutional neural networks , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[35]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.

[36]  Božidar Potočnik,et al.  LSUN-Stanford Car Dataset: Enhancing Large-Scale Car Image Datasets Using Deep Learning for Usage in GAN Training , 2020, Applied Sciences.

[37]  Padraig Cunningham,et al.  Ensemble based system for whole-slide prostate cancer probability mapping using color texture features , 2011, Comput. Medical Imaging Graph..

[38]  Adam Glowacz,et al.  Multistage Segmentation of Prostate Cancer Tissues Using Sample Entropy Texture Analysis , 2020, Entropy.

[39]  Yun Gu,et al.  Multi-level magnification correlation hashing for scalable histopathological image retrieval , 2019, Neurocomputing.

[40]  Manfredo Atzori,et al.  Chapter 10 – Analysis of Histopathology Images: From Traditional Machine Learning to Deep Learning , 2017 .

[41]  A. Tabesh,et al.  Tumor Classification in Histological Images of Prostate Using Color Texture , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[42]  Ayman El-Baz,et al.  A new CNN-based system for early diagnosis of prostate cancer , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[43]  Yalda Mohsenzadeh,et al.  Low Resolution Face Recognition Using a Two-Branch Deep Convolutional Neural Network Architecture , 2017, Expert Syst. Appl..

[44]  George Lee,et al.  Computer-aided prognosis: Predicting patient and disease outcome via quantitative fusion of multi-scale, multi-modal data , 2011, Comput. Medical Imaging Graph..

[45]  Arkadiusz Gertych,et al.  A Machine Learning Approach to Identify Prostate Cancer Areas in Complex Histological Images , 2014 .

[46]  A. Linares-Barranco,et al.  Performance Evaluation of Deep Learning-Based Prostate Cancer Screening Methods in Histopathological Images: Measuring the Impact of the Model’s Complexity on Its Processing Speed , 2021, Sensors.

[47]  Chao-Hui Huang,et al.  Automated classification for pathological prostate images using AdaBoost-based Ensemble Learning , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[48]  Richard J. Chen,et al.  Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images , 2018, IEEE Transactions on Medical Imaging.

[49]  Hamid Soltanian-Zadeh,et al.  Multiwavelet grading of pathological images of prostate , 2003, IEEE Transactions on Biomedical Engineering.

[50]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[51]  J. S. Marron,et al.  Appearance Normalization of Histology Slides , 2010, MLMI.

[52]  Kim,et al.  Quantitative Analysis of Benign and Malignant Tumors in Histopathology: Predicting Prostate Cancer Grading Using SVM , 2019, Applied Sciences.

[53]  Madhu S. Nair,et al.  Computer-Aided Histopathological Image Analysis Techniques for Automated Nuclear Atypia Scoring of Breast Cancer: a Review , 2020, Journal of Digital Imaging.

[54]  Muhammed Fatih Talu,et al.  Resizing and cleaning of histopathological images using generative adversarial networks , 2020 .

[55]  Anant Madabhushi,et al.  Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[56]  Neofytos Dimitriou,et al.  Deep Learning for Whole Slide Image Analysis: An Overview , 2019, Front. Med..

[57]  Xiubao Sui,et al.  Range Limited Bi-Histogram Equalization for image contrast enhancement , 2013 .

[58]  Adam Piórkowski.  Color Normalization-Based Nuclei Detection in Images of Hematoxylin and Eosin-Stained Multi Organ Tissues , 2019, IP&C.

[59]  S. Matthews,et al.  New Screening Test Improves Detection of Prostate Cancer Using Circulating Tumor Cells and Prostate-Specific Markers , 2020, Frontiers in Oncology.

[60]  Fábio Hernandes,et al.  Fuzzy expert system for predicting pathological stage of prostate cancer , 2013, Expert Syst. Appl..

[61]  Rizwan Ali Naqvi,et al.  Learning Medical Image Denoising with Deep Dynamic Residual Attention Network , 2020, Mathematics.

[62]  G. V. van Leenders,et al.  Prognostic Histopathological and Molecular Markers on Prostate Cancer Needle-Biopsies: A Review , 2014, BioMed research international.

[63]  Purang Abolmaesumi,et al.  Separation of Benign and Malignant Glands in Prostatic Adenocarcinoma , 2013, MICCAI.

[64]  Anant Madabhushi,et al.  Content-based image retrieval utilizing explicit shape descriptors: applications to breast MRI and prostate histopathology , 2011, Medical Imaging.

[65]  Adel Al-Jumaily,et al.  The Beneficial Techniques in Preprocessing Step of Skin Cancer Detection System Comparing , 2014 .

[66]  Manoj Gupta,et al.  Image De-noising by Various Filters for Different Noise , 2010 .

[67]  J. Angel Arul Jothi,et al.  A survey on automated cancer diagnosis from histopathology images , 2017, Artificial Intelligence Review.

[68]  W. Christens-Barry,et al.  Automated image analysis system for detecting boundaries of live prostate cancer cells. , 1998, Cytometry.

[69]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[70]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[71]  Fouad Khelifi,et al.  Automatic classification of colorectal and prostatic histologic tumor images using multiscale multispectral local binary pattern texture features and stacked generalization , 2018, Neurocomputing.

[72]  Peter L Choyke,et al.  Artificial intelligence at the intersection of pathology and radiology in prostate cancer. , 2019, Diagnostic and interventional radiology.

[73]  A. Madabhushi.  Digital pathology image analysis: opportunities and challenges. , 2009, Imaging in medicine.

[74]  Ayman El-Baz,et al.  In-vitro and in-vivo diagnostic techniques for prostate cancer: a review. , 2014, Journal of biomedical nanotechnology.

[75]  Shahnorbanun Sahran,et al.  Multi-scoring feature selection method based on SVM-RFE for prostate cancer diagnosis , 2015, 2015 International Conference on Electrical Engineering and Informatics (ICEEI).

[76]  Loris Nanni,et al.  General Purpose (GenP) Bioimage Ensemble of Handcrafted and Learned Features with Data Augmentation , 2019, ArXiv.

[77]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[78]  Angel Cruz-Roa,et al.  Representación de imágenes de histopatología utilizada en tareas de análisis automático: estado del arte , 2014 .

[79]  Sarah M. Ayyad,et al.  Classification Techniques in Gene Expression Microarray Data , 2018 .

[80]  Ke Yan,et al.  Data augmentation using generative adversarial networks (CycleGAN) to improve generalizability in CT segmentation tasks , 2019, Scientific Reports.

[81]  Luiz Eduardo Soares de Oliveira,et al.  Histopathologic Image Processing: A Review , 2019, ArXiv.

[82]  Bram van Ginneken,et al.  Automated Gleason Grading of Prostate Biopsies using Deep Learning , 2019, ArXiv.

[83]  Yulei Jiang,et al.  Computer-aided identification of prostatic adenocarcinoma: Segmentation of glandular structures , 2011, Journal of pathology informatics.

[84]  S. Berkovsky,et al.  Isocitrate dehydrogenase (IDH) status prediction in histopathology images of gliomas using deep learning , 2020, Scientific Reports.

[85]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[86]  Peter Meer,et al.  Unsupervised segmentation based on robust estimation and color active contour models , 2005, IEEE Transactions on Information Technology in Biomedicine.

[87]  Sos S. Agaian,et al.  Automated classification of histopathology images of prostate cancer using a Bag-of-Words approach , 2016, Commercial + Scientific Sensing and Imaging.

[88]  Karen E. Burtt,et al.  Computer Aided-Diagnosis of Prostate Cancer on Multiparametric MRI: A Technical Review of Current Research , 2014, BioMed research international.

[89]  Gang Wang,et al.  Automatic grading of prostate cancer in digitized histopathology images: Learning from multiple experts , 2018, Medical Image Anal..

[90]  Mehreen Tariq,et al.  Medical image based breast cancer diagnosis: State of the art and future directions , 2020, Expert Syst. Appl..

[91]  anonymous.  In Review , 2018 .

[92]  Smaranda Belciug,et al.  Automated Gleason grading of prostate cancer using transfer learning from general-purpose deep-learning networks , 2020, Romanian journal of morphology and embryology = Revue roumaine de morphologie et embryologie.

[93]  R. Krithiga,et al.  Breast Cancer Detection, Segmentation and Classification on Histopathology Images Analysis: A Systematic Review , 2020, Archives of Computational Methods in Engineering.

[94]  Yuri Tolkach,et al.  High-accuracy prostate cancer pathology using deep learning , 2020, Nature Machine Intelligence.

[95]  John Arevalo,et al.  HISTOPATHOLOGY IMAGE REPRESENTATION FOR AUTOMATIC ANALYSIS: A STATE-OF-THE-ART REVIEW , 2014 .

[96]  Hwee Kuan Lee,et al.  Gland segmentation in prostate histopathological images , 2017, Journal of medical imaging.

[97]  Shashidhar B. Gurav,et al.  PROSTATE CANCER DETECTION USING HISTOPATHOLOGY IMAGES AND CLASSIFICATION USING IMPROVED RideNN , 2019 .

[98]  P. Shanmugavadivu,et al.  Particle swarm optimized multi-objective histogram equalization for image enhancement , 2014 .

[99]  J. Angel Arul Jothi,et al.  A survey on automated cancer diagnosis from histopathology images , 2017 .

[100]  P. Humphrey,et al.  Histopathology of Prostate Cancer. , 2017, Cold Spring Harbor perspectives in medicine.

[101]  Jocelyn Barker,et al.  A method for normalizing pathology images to improve feature extraction for quantitative pathology. , 2016, Medical physics.

[102]  Alexi Baidoshvili,et al.  Impact of rescanning and normalization on convolutional neural network performance in multi-center, whole-slide classification of prostate cancer , 2020, Scientific Reports.

[103]  L. Fiette,et al.  Histopathology procedures: from tissue sampling to histopathological evaluation. , 2011, Methods in molecular biology.

[104]  Metin Nafi Gürcan,et al.  Content-Based Microscopic Image Retrieval System for Multi-Image Queries , 2012, IEEE Transactions on Information Technology in Biomedicine.

[105]  Anil K. Jain,et al.  Automated Gland Segmentation and Classification for Gleason Grading of Prostate Tissue Images , 2010, 2010 20th International Conference on Pattern Recognition.

[106]  Asmaa H. Rabie,et al.  Detecting COVID-19 patients based on fuzzy inference engine and Deep Neural Network , 2020, Applied Soft Computing.

[107]  Ahmed I. Saleh,et al.  A new distributed feature selection technique for classifying gene expression data , 2019, International Journal of Biomathematics.

[108]  Anant Madabhushi,et al.  AUTOMATED GRADING OF PROSTATE CANCER USING ARCHITECTURAL AND TEXTURAL IMAGE FEATURES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[109]  M. Arif,et al.  Classification of potential nuclei in prostate histology images using shape manifold learning , 2007, 2007 International Conference on Machine Vision.

[110]  Wenyuan Li,et al.  Path R-CNN for Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2019, IEEE Transactions on Medical Imaging.

[111]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.