Deep Learning for Real-time, Automatic, and Scanner-adapted Prostate (Zone) Segmentation of Transrectal Ultrasound, for Example, Magnetic Resonance Imaging-transrectal Ultrasound Fusion Prostate Biopsy.

BACKGROUND Although recent advances in multiparametric magnetic resonance imaging (MRI) led to an increase in MRI-transrectal ultrasound (TRUS) fusion prostate biopsies, these are time consuming, laborious, and costly. Introduction of deep-learning approach would improve prostate segmentation. OBJECTIVE To exploit deep learning to perform automatic, real-time prostate (zone) segmentation on TRUS images from different scanners. DESIGN, SETTING, AND PARTICIPANTS Three datasets with TRUS images were collected at different institutions, using an iU22 (Philips Healthcare, Bothell, WA, USA), a Pro Focus 2202a (BK Medical), and an Aixplorer (SuperSonic Imagine, Aix-en-Provence, France) ultrasound scanner. The datasets contained 436 images from 181 men. OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS Manual delineations from an expert panel were used as ground truth. The (zonal) segmentation performance was evaluated in terms of the pixel-wise accuracy, Jaccard index, and Hausdorff distance. RESULTS AND LIMITATIONS The developed deep-learning approach was demonstrated to significantly improve prostate segmentation compared with a conventional automated technique, reaching median accuracy of 98% (95% confidence interval 95-99%), a Jaccard index of 0.93 (0.80-0.96), and a Hausdorff distance of 3.0 (1.3-8.7) mm. Zonal segmentation yielded pixel-wise accuracy of 97% (95-99%) and 98% (96-99%) for the peripheral and transition zones, respectively. Supervised domain adaptation resulted in retainment of high performance when applied to images from different ultrasound scanners (p > 0.05). Moreover, the algorithm's assessment of its own segmentation performance showed a strong correlation with the actual segmentation performance (Pearson's correlation 0.72, p < 0.001), indicating that possible incorrect segmentations can be identified swiftly. CONCLUSIONS Fusion-guided prostate biopsies, targeting suspicious lesions on MRI using TRUS are increasingly performed. The requirement for (semi)manual prostate delineation places a substantial burden on clinicians. Deep learning provides a means for fast and accurate (zonal) prostate segmentation of TRUS images that translates to different scanners. PATIENT SUMMARY Artificial intelligence for automatic delineation of the prostate on ultrasound was shown to be reliable and applicable to different scanners. This method can, for example, be applied to speed up, and possibly improve, guided prostate biopsies using magnetic resonance imaging-transrectal ultrasound fusion.

[1]  J. Ciezki,et al.  Influence of zonal dosimetry on prostate brachytherapy outcomes , 2014, Journal of contemporary brachytherapy.

[2]  M. Gross,et al.  Trans-rectal ultrasound visibility of prostate lesions identified by magnetic resonance imaging increases accuracy of image-fusion targeted biopsies , 2015, World Journal of Urology.

[3]  J. McNeal The zonal anatomy of the prostate , 1981, The Prostate.

[4]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[5]  Dean C. Barratt,et al.  Automatic slice segmentation of intraoperative transrectal ultrasound images using convolutional neural networks , 2018, Medical Imaging.

[6]  S. Arora,et al.  Magnetic resonance-ultrasound fusion prostate biopsy in the diagnosis of prostate cancer. , 2016, Urologic oncology.

[7]  T. Loch,et al.  A 12-year follow-up of ANNA/C-TRUS image-targeted biopsies in patients suspicious for prostate cancer , 2018, World Journal of Urology.

[8]  U. Rajendra Acharya,et al.  Segmentation of prostate contours for automated diagnosis using ultrasound images: A survey , 2017, J. Comput. Sci..

[9]  Yi Yang Liu,et al.  Comparisons of oncological and functional outcomes among radical retropubic prostatectomy, high dose rate brachytherapy, cryoablation and high-intensity focused ultrasound for localized prostate cancer , 2016, SpringerPlus.

[10]  Stig Müller,et al.  Poor reproducibility of PIRADS score in two multiparametric MRIs before biopsy in men with elevated PSA , 2018, World Journal of Urology.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  F. Frauscher,et al.  Applications of transrectal ultrasound in prostate cancer. , 2012, The British journal of radiology.

[13]  L. Hooft,et al.  Comparing Three Different Techniques for Magnetic Resonance Imaging-targeted Prostate Biopsies: A Systematic Review of In-bore versus Magnetic Resonance Imaging-transrectal Ultrasound fusion versus Cognitive Registration. Is There a Preferred Technique? , 2017, European urology.

[14]  D. Margolis,et al.  MRI‐Targeted or Standard Biopsy for Prostate‐Cancer Diagnosis , 2018, The New England journal of medicine.

[15]  A. Villers,et al.  Beyond transrectal ultrasound-guided prostate biopsies: available techniques and approaches , 2018, World Journal of Urology.

[16]  Aaron Fenster,et al.  Mechanically assisted 3D ultrasound guided prostate biopsy system. , 2008, Medical physics.

[17]  P. Dunscombe,et al.  Inter- and intra-observer variability in prostate definition with tissue harmonic and brightness mode imaging. , 2012, International journal of radiation oncology, biology, physics.

[18]  Desire Sidibé,et al.  A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images , 2012, Comput. Methods Programs Biomed..

[19]  Baris Turkbey,et al.  Current status of magnetic resonance imaging (MRI) and ultrasonography fusion software platforms for guidance of prostate biopsies , 2014, BJU international.

[20]  M M Elhilali,et al.  Reassessment of nonplanimetric transrectal ultrasound prostate volume estimates. , 1996, Urology.

[21]  Ilgar Akbarov,et al.  How to Perform Image-guided Prostate Biopsy: In-bore and Fusion Approaches. , 2016, European urology focus.

[22]  Yongmin Kim,et al.  Edge-guided boundary delineation in prostate ultrasound images , 2000, IEEE Transactions on Medical Imaging.

[23]  Konstantinos Kamnitsas,et al.  Unsupervised domain adaptation in brain lesion segmentation with adversarial networks , 2016, IPMI.

[24]  R G Aarnink,et al.  Edge detection in prostatic ultrasound images using integrated edge maps. , 1998, Ultrasonics.

[25]  E J Feleppa,et al.  Spectrum-Analysis and Neural Networks for Imaging to Detect and Treat Prostate Cancer , 2001, Ultrasonic imaging.

[26]  Florian Jung,et al.  Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge , 2014, Medical Image Anal..

[27]  M. Mischi,et al.  Multiparametric dynamic contrast-enhanced ultrasound imaging of prostate cancer , 2016, European Radiology.

[28]  Yongmin Kim,et al.  Parametric shape modeling using deformable superellipses for prostate segmentation , 2004, IEEE Transactions on Medical Imaging.

[29]  M. Terris,et al.  Ultrasound anatomy of the prostate: the normal gland and anatomical variations. , 1990, The Journal of urology.

[30]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[31]  Zhiqiang Tian,et al.  PSNet: prostate segmentation on MRI based on a convolutional neural network , 2018, Journal of medical imaging.

[32]  L. Watson Ultrasound anatomy for prostate brachytherapy. , 1997, Seminars in surgical oncology.

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  Thomas Hambrock,et al.  Simulated required accuracy of image registration tools for targeting high-grade cancer components with prostate biopsies , 2013, European Radiology.

[35]  Purang Abolmaesumi,et al.  A deep learning approach for real time prostate segmentation in freehand ultrasound guided biopsy , 2018, Medical Image Anal..

[36]  E. Halpern,et al.  Contrast-enhanced ultrasound imaging of prostate cancer. , 2006, Reviews in urology.

[37]  Rémi Souchon,et al.  Stiffness of benign and malignant prostate tissue measured by shear-wave elastography: a preliminary study , 2017, European Radiology.

[38]  Jurgen J Fütterer,et al.  Cost-Effectiveness Comparison of Imaging-Guided Prostate Biopsy Techniques: Systematic Transrectal Ultrasound, Direct In-Bore MRI, and Image Fusion. , 2017, AJR. American journal of roentgenology.

[39]  M. Stöckle,et al.  Artificial neural network analysis (ANNA) of prostatic transrectal ultrasound , 1999, The Prostate.