Deep Learning for Predicting Enhancing Lesions in Multiple Sclerosis from Noncontrast MRI.

Background Enhancing lesions on MRI scans obtained after contrast material administration are commonly thought to represent disease activity in multiple sclerosis (MS); it is desirable to develop methods that can predict enhancing lesions without the use of contrast material. Purpose To evaluate whether deep learning can predict enhancing lesions on MRI scans obtained without the use of contrast material. Materials and Methods This study involved prospective analysis of existing MRI data. A convolutional neural network was used for classification of enhancing lesions on unenhanced MRI scans. This classification was performed for each slice, and the slice scores were combined by using a fully connected network to produce participant-wise predictions. The network input consisted of 1970 multiparametric MRI scans from 1008 patients recruited from 2005 to 2009. Enhanced lesions on postcontrast T1-weighted images served as the ground truth. The network performance was assessed by using fivefold cross-validation. Statistical analysis of the network performance included calculation of lesion detection rates and areas under the receiver operating characteristic curve (AUCs). Results MRI scans from 1008 participants (mean age, 37.7 years ± 9.7; 730 women) were analyzed. At least one enhancing lesion was observed in 519 participants. The sensitivity and specificity averaged across the five test sets were 78% ± 4.3 and 73% ± 2.7, respectively, for slice-wise prediction. The corresponding participant-wise values were 72% ± 9.0 and 70% ± 6.3. The diagnostic performances (AUCs) were 0.82 ± 0.02 and 0.75 ± 0.03 for slice-wise and participant-wise enhancement prediction, respectively. Conclusion Deep learning used with conventional MRI identified enhanced lesions in multiple sclerosis from images from unenhanced multiparametric MRI with moderate to high accuracy. © RSNA, 2019.

[1]  Refaat E Gabr,et al.  Brain and lesion segmentation in multiple sclerosis using fully convolutional neural networks: A large-scale study , 2020, Multiple sclerosis.

[2]  Yang Yang,et al.  Glioma Grading on Conventional MR Images: A Deep Learning Study With Transfer Learning , 2018, Front. Neurosci..

[3]  Hanzhang Lu,et al.  Non‐contrast MR imaging of blood‐brain barrier permeability to water , 2018, Magnetic resonance in medicine.

[4]  J. Pauly,et al.  Deep learning enables reduced gadolinium dose for contrast‐enhanced brain MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[5]  D. Maintz,et al.  Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric MRI , 2018, European Radiology.

[6]  Taku Komura,et al.  Segmentation of white matter hyperintensities using convolutional neural networks with global spatial information in routine clinical brain MRI with none or mild vascular pathology , 2018, Comput. Medical Imaging Graph..

[7]  David H. Miller,et al.  Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria , 2017, The Lancet Neurology.

[8]  E. Kanal Gadolinium-based Contrast Agents: The Plot Thickens. , 2017, Radiology.

[9]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[10]  J. Pluim,et al.  Evaluation of a deep learning approach for the segmentation of brain tissues and white matter hyperintensities of presumed vascular origin in MRI , 2017, NeuroImage: Clinical.

[11]  À. Rovira,et al.  Consensus statement on the use of gadolinium for magnetic resonance imaging (MRI) used in the diagnosis and follow-up of patients with multiple sclerosis (MS) , 2017, Journal of the Neurological Sciences.

[12]  Tyler J. Fraum,et al.  Gadolinium‐based contrast agents: A comprehensive risk assessment , 2017, Journal of magnetic resonance imaging : JMRI.

[13]  Fernando Calamante,et al.  Gadolinium deposition in the brain: summary of evidence and recommendations , 2017, The Lancet Neurology.

[14]  D. Kallmes,et al.  Comparison of Gadolinium Concentrations within Multiple Rat Organs after Intravenous Administration of Linear versus Macrocyclic Gadolinium Chelates. , 2017, Radiology.

[15]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[16]  Nicolas Michoux,et al.  Texture Analysis of T2-Weighted MR Images to Assess Acute Inflammation in Brain MS Lesions , 2015, PloS one.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Khader M Hasan,et al.  Effect of in‐painting on cortical thickness measurements in multiple sclerosis: A large cohort study , 2015, Human brain mapping.

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  F. Jacques Defining the clinical course of multiple sclerosis: The 2013 revisions , 2015, Neurology.

[21]  V. Dousset,et al.  MS Lesions Are Better Detected with 3D T1 Gradient-Echo Than with 2D T1 Spin-Echo Gadolinium-Enhanced Imaging at 3T , 2015, American Journal of Neuroradiology.

[22]  P. Narayana,et al.  Regional Gray Matter Atrophy in Relapsing Remitting Multiple Sclerosis: Baseline Analysis of Multi-Center Data , 2015, Multiple sclerosis and related disorders.

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Ponnada A. Narayana,et al.  Effect of Intrinsic and Extrinsic Factors on Global and Regional Cortical Thickness , 2014, PloS one.

[25]  Daisuke Takenaka,et al.  High signal intensity in the dentate nucleus and globus pallidus on unenhanced T1-weighted MR images: relationship with increasing cumulative dose of a gadolinium-based contrast material. , 2014, Radiology.

[26]  Gary R Cutter,et al.  Randomized study combining interferon and glatiramer acetate in multiple sclerosis , 2013, Annals of neurology.

[27]  M. Tullman Overview of the epidemiology, diagnosis, and disease progression associated with multiple sclerosis. , 2013, The American journal of managed care.

[28]  Ponnada A. Narayana,et al.  Regional cortical thickness in relapsing remitting multiple sclerosis: A multi-center study☆ , 2012, NeuroImage: Clinical.

[29]  C. Crainiceanu,et al.  Predicting Breakdown of the Blood-Brain Barrier in Multiple Sclerosis without Contrast Agents , 2012, American Journal of Neuroradiology.

[30]  Jerry S. Wolinsky,et al.  The CombiRx trial of combined therapy with interferon and glatiramer acetate in relapsing remitting MS: Design and baseline characteristics. , 2012, Multiple sclerosis and related disorders.

[31]  D. Clifford,et al.  Natalizumab-associated progressive multifocal leukoencephalopathy. , 2012 .

[32]  Ponnada A Narayana,et al.  Segmentation of gadolinium‐enhanced lesions on MRI in multiple sclerosis , 2007, Journal of magnetic resonance imaging : JMRI.

[33]  T. Grobner Gadolinium--a specific trigger for the development of nephrogenic fibrosing dermopathy and nephrogenic systemic fibrosis? , 2006, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[34]  R. He,et al.  Unified Approach for Multiple Sclerosis Lesion Segmentation on Brain MRI , 2006, Annals of Biomedical Engineering.

[35]  Ponnada A. Narayana,et al.  Segmentation and quantification of black holes in multiple sclerosis , 2006, NeuroImage.

[36]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[37]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .