Computer aided detection of prostate cancer using multiwavelength photoacoustic data with convolutional neural network

Abstract In a conventional computer aided diagnosis workflow, features/markers, which are extracted from regions of interest in medical images, are analysed and assigned to different classes corresponding to normal and diseased organ. A convolutional neural network (CNN) based classifier can autonomously extract discriminative features from the medical images and then perform classification using these extracted features. The aim of this study was to evaluate the performance of autonomously learned features from photoacoustic data by the convolution layer of a CNN for differentiating between different tissue pathologies. In this study, CNN based classifiers were trained with photoacoustic data, generated from freshly excised prostates of 30 human patients who went prostatectomy for biopsy confirmed prostate cancer. Three different photoacoustic datasets, acquired at 760 nm, 800 nm and 850 nm wavelengths and the combination of all three datasets, were employed to autonomously learn discriminative features by CNN and these features were utilised with different classifiers for differentiating among malignant prostate, benign prostatic hyperplasia and normal prostate tissue. The performance of these classifiers was compared with the performance of classifiers applied with raw photoacoustic data. Two out of three CNN based classifiers provided accuracy as well as sensitivity values which were approximately equal to or higher than 0.92 for malignant versus non malignant prostate tissue classification and malignant versus normal prostate tissue classification using the combined photoacoustic dataset. The preliminary results of this study show that features learned by CNN can be successfully used for efficient prostate tissue characterisation using Photoacoustic data.

[1]  Jian Chen,et al.  Transurethral Photoacoustic Endoscopy for Prostate Cancer: A Simulation Study , 2016, IEEE Transactions on Medical Imaging.

[2]  Michael Kelm,et al.  Automatic detection of lytic and blastic thoracolumbar spine metastases on computed tomography , 2013, European Radiology.

[3]  Quing Zhu,et al.  Coregistered photoacoustic and ultrasound imaging and classification of ovarian cancer: ex vivo and in vivo studies , 2016, Journal of biomedical optics.

[4]  Ronald M. Summers,et al.  A New 2.5D Representation for Lymph Node Detection Using Random Sets of Deep Convolutional Neural Network Observations , 2014, MICCAI.

[5]  Saugata Sinha,et al.  Evaluation of Frequency Domain Analysis of a Multiwavelength Photoacoustic Signal for Differentiating Malignant From Benign and Normal Prostates , 2016, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[6]  Ronald M. Summers,et al.  Detection of Sclerotic Spine Metastases via Random Aggregation of Deep Convolutional Neural Network Classifications , 2014, ArXiv.

[7]  Xuan Zeng,et al.  HeartID: A Multiresolution Convolutional Neural Network for ECG-Based Biometric Human Identification in Smart Health Applications , 2017, IEEE Access.

[8]  Saeid Sanei,et al.  Detection of Interictal Discharges With Convolutional Neural Networks Using Discrete Ordered Multichannel Intracranial EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  H. Shinmoto,et al.  A pilot study of photoacoustic imaging system for improved real‐time visualization of neurovascular bundle during radical prostatectomy , 2016, The Prostate.

[10]  R. Witte,et al.  3-D photoacoustic and pulse echo imaging of prostate tumor progression in the mouse window chamber. , 2011, Journal of biomedical optics.

[11]  U. Patel TRUS and prostate biopsy: current status , 2004, Prostate Cancer and Prostatic Diseases.

[12]  Seong Ho Park,et al.  Contrast-enhanced sonography for prostate cancer detection in patients with indeterminate clinical findings. , 2006, AJR. American journal of roentgenology.

[13]  Joseph E. Burns,et al.  Automated detection of sclerotic metastases in the thoracolumbar spine at CT. , 2013, Radiology.

[14]  Yang Song,et al.  Computer‐aided diagnosis of prostate cancer using a deep convolutional neural network from multiparametric MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[15]  Quing Zhu,et al.  Recognition algorithm for assisting ovarian cancer diagnosis from coregistered ultrasound and photoacoustic images: ex vivo study , 2012, Journal of biomedical optics.

[16]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[17]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[18]  Khashayar Khorasani,et al.  Deep Convolutional Neural Networks and Learning ECG Features for Screening Paroxysmal Atrial Fibrillation Patients , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Y. Lotan,et al.  Cost consideration in utilization of multiparametric magnetic resonance imaging in prostate cancer , 2017, Translational andrology and urology.

[20]  E. Halpern,et al.  Contrast-enhanced ultrasound imaging of prostate cancer. , 2006, Reviews in urology.

[21]  Saugata Sinha,et al.  Frequency Domain Analysis of Multiwavelength Photoacoustic Signals for Differentiating Among Malignant, Benign, and Normal Thyroids in an Ex Vivo Study With Human Thyroids , 2017, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[22]  J. Presti,et al.  Prostate biopsy: current status and limitations. , 2007, Reviews in urology.

[23]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[24]  Quing Zhu,et al.  Utilizing spatial and spectral features of photoacoustic imaging for ovarian cancer detection and diagnosis , 2015, Journal of biomedical optics.

[25]  Tyler Harrison,et al.  Coregistered photoacoustic-ultrasound imaging applied to brachytherapy. , 2011, Journal of biomedical optics.

[26]  Maarten de Rooij,et al.  Cost-effectiveness of magnetic resonance (MR) imaging and MR-guided targeted biopsy versus systematic transrectal ultrasound-guided biopsy in diagnosing prostate cancer: a modelling study from a health care perspective. , 2014, European urology.

[27]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[28]  Xiaogang Wang,et al.  Medical image classification with convolutional neural network , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[29]  Ragnar Olafsson,et al.  Real-time, contrast enhanced photoacoustic imaging of cancer in a mouse window chamber. , 2010, Optics express.

[30]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Baris Turkbey,et al.  Comparison of MR/ultrasound fusion-guided biopsy with ultrasound-guided biopsy for the diagnosis of prostate cancer. , 2015, JAMA.

[32]  M. A. Yaseen,et al.  Optoacoustic imaging of the prostate: development toward image-guided biopsy. , 2010, Journal of biomedical optics.

[33]  M. Brock,et al.  The impact of real-time elastography guiding a systematic prostate biopsy to improve cancer detection rate: a prospective study of 353 patients. , 2012, The Journal of urology.

[34]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[35]  Lihong V. Wang Photoacoustic imaging and spectroscopy , 2009 .

[36]  Yike Guo,et al.  Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks , 2016, ArXiv.

[37]  H. Shinmoto,et al.  Pilot Study of Prostate Cancer Angiogenesis Imaging Using a Photoacoustic Imaging System. , 2017, Urology.

[38]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[39]  Sarah E Bohndiek,et al.  Oxygen Enhanced Optoacoustic Tomography (OE-OT) Reveals Vascular Dynamics in Murine Models of Prostate Cancer , 2017, Theranostics.