Multiparametric deep learning tissue signatures for a radiological biomarker of breast cancer: Preliminary results

Purpose Deep learning is emerging in radiology due to the increased computational capabilities available to reading rooms. These computational developments have the ability to mimic the radiologist and may allow for more accurate tissue characterization of normal and pathological lesion tissue to assist radiologists in defining different diseases. We introduce a novel tissue signature model based on tissue characteristics in breast tissue from multiparametric magnetic resonance imaging (mpMRI). The breast tissue signatures are used as inputs in a stacked sparse autoencoder (SSAE) multiparametric deep learning (MPDL) network for segmentation of breast mpMRI. Methods We constructed the MPDL network from SSAE with 5 layers with 10 nodes at each layer. A total cohort of 195 breast cancer subjects were used for training and testing of the MPDL network. The cohort consisted of a training dataset of 145 subjects and an independent validation set of 50 subjects. After segmentation, we used a combined SAE‐support vector machine (SAE‐SVM) learning method for classification. Dice similarity (DS) metrics were calculated between the segmented MPDL and dynamic contrast enhancement (DCE) MRI‐defined lesions. Sensitivity, specificity, and area under the curve (AUC) metrics were used to classify benign from malignant lesions. Results The MPDL segmentation resulted in a high DS of 0.87 ± 0.05 for malignant lesions and 0.84 ± 0.07 for benign lesions. The MPDL had excellent sensitivity and specificity of 86% and 86% with positive predictive and negative predictive values of 92% and 73%, respectively, and an AUC of 0.90. Conclusions Using a new tissue signature model as inputs into the MPDL algorithm, we have successfully validated MPDL in a large cohort of subjects and achieved results similar to radiologists.

[1]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[2]  Min-Ying Su,et al.  Automatic Breast and Fibroglandular Tissue Segmentation in Breast MRI Using Deep Learning by a Fully-Convolutional Residual Neural Network U-Net. , 2019, Academic radiology.

[3]  D. Margolis,et al.  PI-RADS Steering Committee: The PI-RADS Multiparametric MRI and MRI-directed Biopsy Pathway. , 2019, Radiology.

[4]  A. Ng,et al.  Deep Learning–Assisted Diagnosis of Cerebral Aneurysms Using the HeadXNet Model , 2019, JAMA network open.

[5]  Yao Lu,et al.  Coordinate-guided U-Net for automated breast segmentation on MRI images , 2019, International Conference on Graphic and Image Processing.

[6]  Lei Zhang,et al.  Automated deep-learning method for whole-breast segmentation in diffusion-weighted breast MRI , 2019, Medical Imaging.

[7]  Vishwa S. Parekh,et al.  Deep learning and radiomics in precision medicine , 2019, Expert review of precision medicine and drug development.

[8]  Kathryn J Fowler,et al.  Measurement Repeatability of 18F-FDG PET/CT Versus 18F-FDG PET/MRI in Solid Tumors of the Pelvis , 2019, The Journal of Nuclear Medicine.

[9]  Dorit Merhof,et al.  Radiomic versus Convolutional Neural Networks Analysis for Classification of Contrast-enhancing Lesions at Multiparametric Breast MRI. , 2019, Radiology.

[10]  Jun Zhang,et al.  Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics , 2019, IEEE Transactions on Medical Imaging.

[11]  Dorin Comaniciu,et al.  Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Vishwa S. Parekh,et al.  Radiomic Synthesis Using Deep Convolutional Neural Networks , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[13]  Jie Yang,et al.  A Spatio-Temporal Fully Convolutional Network for Breast Lesion Segmentation in DCE-MRI , 2018, ICONIP.

[14]  Yang Song,et al.  Computer‐aided diagnosis of prostate cancer using a deep convolutional neural network from multiparametric MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[15]  Eduard Schreibmann,et al.  A convolutional neural network to filter artifacts in spectroscopic MRI , 2018, Magnetic resonance in medicine.

[16]  Guang-Zhong Yang,et al.  Small Lesion Classification in Dynamic Contrast Enhancement MRI for Breast Cancer Early Detection , 2018, MICCAI.

[17]  Carlo Sansone,et al.  Breast Segmentation in MRI via U-Net Deep Convolutional Neural Networks , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[18]  Ayman El-Baz,et al.  Deep Learning Role in Early Diagnosis of Prostate Cancer , 2018, Technology in cancer research & treatment.

[19]  Nico Karssemeijer,et al.  Fully automated detection of breast cancer in screening MRI using convolutional neural networks , 2018, Journal of medical imaging.

[20]  Guy Amit,et al.  Hybrid Mass Detection in Breast MRI Combining Unsupervised Saliency Analysis and Deep Learning , 2017, MICCAI.

[21]  Gustavo Carneiro,et al.  Deep Reinforcement Learning for Active Breast Lesion Detection from DCE-MRI , 2017, MICCAI.

[22]  Gustavo Carneiro,et al.  Globally optimal breast mass segmentation from DCE-MRI using deep semantic segmentation as shape prior , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[23]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[24]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[25]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[26]  Michael Hogarth,et al.  Adaptive Randomization of Neratinib in Early Breast Cancer. , 2016, The New England journal of medicine.

[27]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[28]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[29]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[30]  Gary S Collins,et al.  Sample size considerations for the external validation of a multivariable prognostic model: a resampling study , 2015, Statistics in medicine.

[31]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[32]  Michael A. Jacobs,et al.  TU-CD-BRA-01: A Novel 3D Registration Method for Multiparametric Radiological Images , 2015 .

[33]  D. Giavarina Understanding Bland Altman analysis , 2015, Biochemia medica.

[34]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[35]  Katarzyna J Macura,et al.  Multiparametric and Multimodality Functional Radiological Imaging for Breast Cancer Diagnosis and Early Treatment Response Assessment. , 2015, Journal of the National Cancer Institute. Monographs.

[36]  Bin Fang,et al.  Scene classification based on single-layer SAE and SVM , 2015, Expert Syst. Appl..

[37]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[38]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[39]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[40]  Sidong Liu,et al.  Early diagnosis of Alzheimer's disease with deep learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[41]  Vince D. Calhoun,et al.  Deep learning for neuroimaging: a validation study , 2013, Front. Neurosci..

[42]  Roger C. Tam,et al.  Manifold Learning of Brain MRIs by Deep Learning , 2013, MICCAI.

[43]  A. Partin,et al.  Multiparametric magnetic resonance imaging findings in men with low‐risk prostate cancer followed using active surveillance , 2013, BJU international.

[44]  Dan Wang,et al.  Modeling Physiological Data with Deep Belief Networks. , 2013, International journal of information and education technology.

[45]  Nola Hylton,et al.  Pathologic complete response predicts recurrence-free survival more effectively by cancer subset: results from the I-SPY 1 TRIAL--CALGB 150007/150012, ACRIN 6657. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[46]  A. González,et al.  Segmentation of brain MRI structures with deep machine learning , 2012 .

[47]  L. Esserman,et al.  Locally advanced breast cancer: MR imaging for prediction of response to neoadjuvant chemotherapy--results from ACRIN 6657/I-SPY TRIAL. , 2012, Radiology.

[48]  Woo Kyung Moon,et al.  Comparison of diffusion-weighted MR imaging and FDG PET/CT to predict pathological complete response to neoadjuvant chemotherapy in patients with breast cancer , 2011, European Radiology.

[49]  Mark Rosen,et al.  Breast MR imaging: current indications and advanced imaging techniques. , 2010, Radiologic clinics of North America.

[50]  Katarzyna J Macura,et al.  Diffusion-weighted imaging improves the diagnostic accuracy of conventional 3.0-T breast MR imaging. , 2010, Radiology.

[51]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[52]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[53]  Quoc V. Le,et al.  Measuring Invariances in Deep Networks , 2009, NIPS.

[54]  Wendy B DeMartini,et al.  Quantitative diffusion-weighted imaging as an adjunct to conventional breast MRI for improved positive predictive value. , 2009, AJR. American journal of roentgenology.

[55]  D. Bluemke,et al.  Dynamic contrast-enhanced MRI of the breast: quantitative method for kinetic curve type assessment. , 2009, AJR. American journal of roentgenology.

[56]  D. Berry,et al.  I‐SPY 2: An Adaptive Breast Cancer Trial Design in the Setting of Neoadjuvant Chemotherapy , 2009, Clinical pharmacology and therapeutics.

[57]  K. Macura Multiparametric magnetic resonance imaging of the prostate: current status in prostate cancer detection, localization, and staging. , 2008, Seminars in roentgenology.

[58]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[59]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[60]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[61]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[62]  N. Hylton,et al.  Diagnostic architectural and dynamic features at breast MR imaging: multicenter study. , 2006, Radiology.

[63]  N. Hylton,et al.  Magnetic resonance imaging of the breast prior to biopsy. , 2004, JAMA.

[64]  Andrew P. Bradley,et al.  Sample size estimation using the receiver operating characteristic curve , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[65]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[66]  Ning-Yu An,et al.  Differentiation of clinically benign and malignant breast lesions using diffusion‐weighted imaging , 2002, Journal of magnetic resonance imaging : JMRI.

[67]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[68]  Hamid Soltanian-Zadeh,et al.  Identification of cerebral ischemic lesions in rat using eigenimage filtered magnetic resonance imaging , 1999, Brain Research.

[69]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[70]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[71]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[72]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[73]  T. Mikkelsen,et al.  Cerebral tumor volume calculations using planimetric and eigenimage analysis. , 1996, Medical physics.

[74]  H Soltanian-Zadeh,et al.  Optimization of MRI protocols and pulse sequence parameters for eigenimage filtering. , 1994, IEEE transactions on medical imaging.

[75]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[76]  J P Windham,et al.  Eigenimage Filtering in MR Imaging , 1988, Journal of computer assisted tomography.

[77]  Dana H. Ballard,et al.  Modular Learning in Neural Networks , 1987, AAAI.

[78]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[79]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[80]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[81]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[82]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .