Automated Gleason grading of prostate cancers via deep learning in label-free multiphoton microscopic images

In the current clinical care, Gleason grading system based on the architectural pattern of cancerous epithelium in histological images is the most powerful prognostic predictor for prostate cancers (PCa). However, the standard procedure of histological examination often includes complicated tissue fixation and staining, which are time-consuming and may delay the diagnosis and surgery. In this study, the unstained prostate tissues were investigated with multiphoton microscopy (MPM) to produce subcellular-resolution images. And then, a deep learning network (AlexNet) was introduced for automated Gleason grading. We achieved an average accuracy of Gleason grading of 78.1%±3.4% for classification. And the area under the curve (AUC) in test set achieves 0.943 which indicates that the proposed model is effective in Gleason grading. At the end, the heat map was performed to visualize the Gleason score of tumour. Our results suggested that MPM, combined with deep learning method, holds the potential to be used as a real-time clinical diagnostic tool for PCa diagnosis.

[1]  B. Delahunt,et al.  International Society of Urological Pathology (ISUP) grading of prostate cancer – An ISUP consensus on contemporary grading , 2016, APMIS : acta pathologica, microbiologica, et immunologica Scandinavica.

[2]  S. Moss,et al.  A UK‐based investigation of inter‐ and intra‐observer reproducibility of Gleason grading of prostatic biopsies , 2006, Histopathology.

[3]  Gang Wang,et al.  Automatic grading of prostate cancer in digitized histopathology images: Learning from multiple experts , 2018, Medical Image Anal..

[4]  Yuting Ling,et al.  Second harmonic generation (SHG) imaging of cancer heterogeneity in ultrasound guided biopsies of prostate in men suspected with prostate cancer , 2017, Journal of biophotonics.

[5]  Stephen A. Boppart,et al.  Stain-free histopathology by programmable supercontinuum pulses , 2016, Nature Photonics.

[6]  Shuangmu Zhuo,et al.  Multiphoton microscopic imaging of histological sections without hematoxylin and eosin staining differentiates carcinoma in situ lesion from normal oesophagus , 2013 .

[7]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[8]  L. Egevad,et al.  A Contemporary Prostate Cancer Grading System: A Validated Alternative to the Gleason Score. , 2016, European urology.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Abhishek Srivastava,et al.  Multiphoton microscopy for structure identification in human prostate and periprostatic tissue: implications in prostate cancer surgery , 2011, BJU international.

[11]  Xiaoqin Zhu,et al.  Spatial and temporal identification of cerebral infarctions based on multiphoton microscopic imaging. , 2018, Biomedical optics express.

[12]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[13]  Tayyar A. Ozkan,et al.  Interobserver variability in Gleason histological grading of prostate cancer , 2016, Scandinavian journal of urology.

[14]  Minsue T. Chen,et al.  Hematoxylin and Eosin Tissue Stain in Mohs Micrographic Surgery: A Review , 2011, Dermatologic surgery : official publication for American Society for Dermatologic Surgery [et al.].

[15]  Antonio Lopez-Beltran,et al.  Current practice of Gleason grading of prostate carcinoma , 2006, Virchows Archiv.

[16]  D M Berney,et al.  Low Gleason score prostatic adenocarcinomas are no longer viable entities , 2007, Histopathology.

[17]  R. Shah,et al.  Recent advances in prostate cancer pathology: Gleason grading and beyond , 2016, Pathology international.

[18]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[19]  T. Guthrie,et al.  Prostate cancer. , 2020, American family physician.

[20]  J. Epstein,et al.  Prostate cancer grading: a decade after the 2005 modified system , 2018, Modern Pathology.

[21]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[22]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.