Deep Learning vs. Conventional Machine Learning: Pilot Study of WMH Segmentation in Brain MRI with Absence or Mild Vascular Pathology

In the wake of the use of deep learning algorithms in medical image analysis, we compared performance of deep learning algorithms, namely the deep Boltzmann machine (DBM), convolutional encoder network (CEN) and patch-wise convolutional neural network (patch-CNN), with two conventional machine learning schemes: Support vector machine (SVM) and random forest (RF), for white matter hyperintensities (WMH) segmentation on brain MRI with mild or no vascular pathology. We also compared all these approaches with a method in the Lesion Segmentation Tool public toolbox named lesion growth algorithm (LGA). We used a dataset comprised of 60 MRI data from 20 subjects in the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database, each scanned once every year during three consecutive years. Spatial agreement score, receiver operating characteristic and precision-recall performance curves, volume disagreement score, agreement with intra-/inter-observer reliability measurements and visual evaluation were used to find the best configuration of each learning algorithm for WMH segmentation. By using optimum threshold values for the probabilistic output from each algorithm to produce binary masks of WMH, we found that SVM and RF produced good results for medium to very large WMH burden but deep learning algorithms performed generally better than conventional ones in most evaluations.

[1]  Taku Komura,et al.  Evaluation of Four Supervised Learning Schemes in White Matter Hyperintensities Segmentation in Absence or Mild Presence of Vascular Pathology , 2017, MIUA.

[2]  M. Hernández,et al.  Manual segmentations of white matter hyperintensities from a subset of 7 ADNI subjects scanned three consecutive years, for inter-/intra-observer reliability analyses , 2017 .

[3]  C. Maríadel,et al.  Reference segmentations of white matter hyperintensities from a subset of 20 subjects scanned three consecutive years , 2016 .

[4]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[5]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[6]  J. Wardlaw,et al.  Rationale, design and methodology of the image analysis protocol for studies of patients with cerebral small vessel disease and mild stroke , 2015, Brain and behavior.

[7]  Lisa Tang,et al.  Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation , 2015, MICCAI.

[8]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Jeffrey N. Chiang,et al.  Optimized Brain Extraction for Pathological Brains (optiBET) , 2014, PloS one.

[10]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[11]  Sterling C. Johnson,et al.  Extracting and summarizing white matter hyperintensities using supervised segmentation methods in Alzheimer's disease risk and aging studies , 2014, Human brain mapping.

[12]  Sterling C. Johnson,et al.  Regional white matter hyperintensities: aging, Alzheimer's disease risk, and cognitive function , 2014, Neurobiology of Aging.

[13]  Benjamin S. Aribisala,et al.  Morphologic, Distributional, Volumetric, and Intensity Characterization of Periventricular Hyperintensities , 2014, American Journal of Neuroradiology.

[14]  Nick C Fox,et al.  Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration , 2013, The Lancet Neurology.

[15]  Benjamin S Aribisala,et al.  Close Correlation between Quantitative and Qualitative Assessments of White Matter Lesions , 2012, Neuroepidemiology.

[16]  Bernhard Hemmer,et al.  An automated tool for detection of FLAIR-hyperintense white-matter lesions in Multiple Sclerosis , 2012, NeuroImage.

[17]  Mark E. Schmidt,et al.  The Alzheimer’s Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[18]  Stefan Klöppel,et al.  A comparison of different automated methods for the detection of white matter lesions in MRI data , 2011, NeuroImage.

[19]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[20]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[21]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[22]  T. Lumley,et al.  PRINCIPAL COMPONENT ANALYSIS AND FACTOR ANALYSIS , 2004, Statistical Methods for Biomedical Research.

[23]  Lijuan Cao,et al.  A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine , 2003, Neurocomputing.

[24]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[25]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[26]  L. Fried,et al.  Clinical correlates of white matter findings on cranial magnetic resonance imaging of 3301 elderly people. The Cardiovascular Health Study. , 1996, Stroke.

[27]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[28]  P. Scheltens,et al.  A semiquantative rating scale for the assessment of signal hyperintensities on magnetic resonance imaging , 1993, Journal of the Neurological Sciences.

[29]  Jerome L. Myers,et al.  Research Design and Statistical Analysis , 1991 .

[30]  A. Alavi,et al.  MR signal abnormalities at 1.5 T in Alzheimer's dementia and normal aging. , 1987, AJR. American journal of roentgenology.

[31]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[32]  Paul Schmidt,et al.  LST: A lesion segmentation tool for SPM , 2019 .

[33]  Mariana Leite,et al.  Etiology-based classification of brain white matter hyperintensity on magnetic resonance imaging , 2015, Journal of medical imaging.

[34]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[35]  Jayaram K. Udupa,et al.  New variants of a method of MRI scale standardization , 2000, IEEE Transactions on Medical Imaging.