End-to-end Prostate Cancer Detection in bpMRI via 3D CNNs: Effect of Attention Mechanisms, Clinical Priori and Decoupled False Positive Reduction

We present a novel multi-stage 3D computer-aided detection and diagnosis (CAD) model1 for automated localization of clinically significant prostate cancer (csPCa) in bi-parametric MR imaging (bpMRI). State-of-the-art attention mechanisms drive its detection network, which aims to accurately discriminate csPCa lesions from indolent cancer and the wide range of benign pathology that can afflict the prostate gland. In parallel, a decoupled residual classifier is used to achieve consistent false positive reduction, without sacrificing high detection sensitivity or computational efficiency. Furthermore, a probabilistic anatomical prior, which captures the spatial prevalence of csPCa and its zonal distinction, is computed and encoded into the CNN architecture to guide model generalization with domain-specific clinical knowledge. For 486 institutional testing scans, the 3D CAD system achieves 83.69±5.22% and 93.19±2.96% detection sensitivity at 0.50 and 1.46 false positive(s) per patient, respectively, along with 0.882 AUROC in patient-based diagnosis –significantly outperforming four state-of-the-art baseline architectures (U-SEResNet, UNet++, nnU-Net, Attention U-Net) from recent literature. For 296 external testing scans, the ensembled CAD system shares moderate agreement with a consensus of expert radiologists (76.69%; kappa = 0.511) and independent pathologists (81.08%; kappa = 0.559); demonstrating a strong ability to localize histologically-confirmed malignancies and generalize beyond the radiologically-estimated annotations of the 1950 training-validation cases used in this study.

[1]  Ahmedin Jemal,et al.  Cancer treatment and survivorship statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[2]  Dean C. Barratt,et al.  Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks , 2018, IEEE Transactions on Medical Imaging.

[3]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[4]  Adam T Froemming,et al.  Interobserver Reproducibility of the PI-RADS Version 2 Lexicon: A Multicenter Study of Six Experienced Prostate Radiologists. , 2016, Radiology.

[5]  D. Margolis,et al.  PI-RADS Prostate Imaging - Reporting and Data System: 2015, Version 2. , 2016, European urology.

[6]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  D. Johnston,et al.  Detailed mapping of prostate carcinoma foci , 2000, Cancer.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[10]  Dorin Comaniciu,et al.  Deep Attentive Panoptic Model for Prostate Cancer Detection Using Biparametric MRI Scans , 2020, MICCAI.

[11]  Dacheng Tao,et al.  Two-Stage Cascaded U-Net: 1st Place Solution to BraTS Challenge 2019 Segmentation Task , 2019, BrainLes@MICCAI.

[12]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[13]  Jinjun Xiong,et al.  Revisiting RCNN: On Awakening the Classification Power of Faster RCNN , 2018, ECCV.

[14]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[15]  A. Padhani,et al.  A systematic review and meta-analysis of the diagnostic accuracy of biparametric prostate MRI for prostate cancer in men at risk , 2020, Prostate Cancer and Prostatic Diseases.

[16]  A. Stenzinger,et al.  Simulated clinical deployment of fully automatic deep learning for clinical prostate MRI assessment , 2020, European Radiology.

[17]  Henkjan Huisman,et al.  Encoding Clinical Priori in 3D Convolutional Neural Networks for Prostate Cancer Detection in bpMRI , 2020, ArXiv.

[18]  Fabien Scalzo,et al.  Prostate Cancer Inference via Weakly-Supervised Learning using a Large Collection of Negative MRI , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[19]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Xu Sun,et al.  Adaptive Gradient Methods with Dynamic Bound of Learning Rate , 2019, ICLR.

[21]  Laurent Lemaitre,et al.  Use of prostate systematic and targeted biopsy on the basis of multiparametric MRI in biopsy-naive patients (MRI-FIRST): a prospective, multicentre, paired diagnostic study. , 2019, The Lancet. Oncology.

[22]  Nico Karssemeijer,et al.  Computer-Aided Detection of Prostate Cancer in MRI , 2014, IEEE Transactions on Medical Imaging.

[23]  Baris Turkbey,et al.  Variability of the Positive Predictive Value of PI-RADS for Prostate MRI across 26 Centers: Experience of the Society of Abdominal Radiology Prostate Cancer Disease-focused Panel. , 2020, Radiology.

[24]  Laura M. Chihara,et al.  Mathematical Statistics with Resampling and R , 2011 .

[25]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[26]  A. Padhani,et al.  Multiparametric Magnetic Resonance Imaging for the Detection of Clinically Significant Prostate Cancer: What Urologists Need to Know. Part 1: Acquisition. , 2020, European urology.

[27]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[28]  Nima Tajbakhsh,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[29]  P. Whiting,et al.  Comparison of Multiparametric Magnetic Resonance Imaging and Targeted Biopsy With Systematic Biopsy Alone for the Diagnosis of Prostate Cancer , 2019, JAMA network open.

[30]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[31]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Tobias Penzkofer,et al.  Semi-automatic classification of prostate cancer on multi-parametric MR imaging using a multi-channel 3D convolutional neural network , 2019, European Radiology.

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  Henkjan Huisman,et al.  Effect of Adding Probabilistic Zonal Prior in Deep Learning-based Prostate Cancer Detection. , 2019, 1907.12382.

[35]  P. Choyke,et al.  Deep‐Learning‐Based Artificial Intelligence for PI‐RADS Classification to Assist Multiparametric Prostate MRI Interpretation: A Development Study , 2020, Journal of magnetic resonance imaging : JMRI.

[36]  Yoshua Bengio,et al.  Inductive Biases for Deep Learning of Higher-Level Cognition , 2020, ArXiv.

[37]  Christina Hulsbergen-van de Kaa,et al.  Head-to-head Comparison of Transrectal Ultrasound-guided Prostate Biopsy Versus Multiparametric Prostate Resonance Imaging with Subsequent Magnetic Resonance-guided Biopsy in Biopsy-naïve Men with Elevated Prostate-specific Antigen: A Large Prospective Multicenter Clinical Study. , 2019, European urology.

[38]  D. Margolis,et al.  MRI‐Targeted or Standard Biopsy for Prostate‐Cancer Diagnosis , 2018, The New England journal of medicine.

[39]  Iasonas Kokkinos,et al.  Harnessing Uncertainty in Domain Adaptation for MRI Prostate Lesion Segmentation , 2020, MICCAI.

[40]  Hao Tang,et al.  NoduleNet: Decoupled False Positive Reductionfor Pulmonary Nodule Detection and Segmentation , 2019, MICCAI.

[41]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[42]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Manuel Wiesenfarth,et al.  Classification of Cancer at Prostate MRI: Deep Learning versus Clinical PI-RADS Assessment. , 2019, Radiology.

[44]  Mingyan Liu,et al.  Characterizing Adversarial Examples Based on Spatial Consistency Information for Semantic Segmentation , 2018, ECCV.

[45]  Masoom A. Haider,et al.  Prostate Cancer Detection using Deep Convolutional Neural Networks , 2019, Scientific Reports.

[46]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  B. Delahunt,et al.  The 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic Carcinoma: Definition of Grading Patterns and Proposal for a New Grading System , 2015, The American journal of surgical pathology.

[48]  Giancarlo Mauri,et al.  USE-Net: incorporating Squeeze-and-Excitation blocks into U-Net for prostate zonal segmentation of multi-institutional MRI datasets , 2019, Neurocomputing.

[49]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[50]  Kingshuk Roy Choudhury,et al.  Detection of prostate cancer with multiparametric MRI (mpMRI): effect of dedicated reader education on accuracy and confidence of index and anterior cancer diagnosis , 2014, Abdominal Imaging.

[51]  Bin Lou,et al.  False Positive Reduction Using Multiscale Contextual Features for Prostate Cancer Detection in Multi-Parametric MRI Scans , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[52]  Baris Turkbey,et al.  Intra‐ and interreader reproducibility of PI‐RADSv2: A multireader study , 2019, Journal of magnetic resonance imaging : JMRI.

[53]  Ruiming Cao,et al.  Joint Prostate Cancer Detection and Gleason Score Prediction in mp-MRI via FocalNet , 2019, IEEE Transactions on Medical Imaging.

[54]  Baris Turkbey,et al.  Multiparametric MRI in prostate cancer management , 2014, Nature Reviews Clinical Oncology.

[55]  D. Margolis,et al.  Prostate Imaging Reporting and Data System Version 2.1: 2019 Update of Prostate Imaging Reporting and Data System Version 2. , 2019, European urology.

[56]  P. Walsh Influence of prostate volume in the detection of prostate cancer. , 2003, The Journal of urology.

[57]  C. Tempany,et al.  The Current State of MR Imaging-targeted Biopsy Techniques for Detection of Prostate Cancer. , 2017, Radiology.

[58]  Mert R. Sabuncu,et al.  Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[59]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  A. Padhani,et al.  Multiparametric Magnetic Resonance Imaging for the Detection of Clinically Significant Prostate Cancer: What Urologists Need to Know. Part 2: Interpretation. , 2019, European urology.

[61]  Carole Lartizien,et al.  Prostate Cancer Semantic Segmentation by Gleason Score Group in bi-parametric MRI with Self Attention Model on the Peripheral Zone , 2020, MIDL.

[62]  Yongdong Zhang,et al.  A Two-Stream Mutual Attention Network for Semi-Supervised Biomedical Segmentation with Noisy Labels , 2018, AAAI.

[63]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.