Segmentation of white matter hyperintensities using convolutional neural networks with global spatial information in routine clinical brain MRI with none or mild vascular pathology

We propose an adaptation of a convolutional neural network (CNN) scheme proposed for segmenting brain lesions with considerable mass-effect, to segment white matter hyperintensities (WMH) characteristic of brains with none or mild vascular pathology in routine clinical brain magnetic resonance images (MRI). This is a rather difficult segmentation problem because of the small area (i.e., volume) of the WMH and their similarity to non-pathological brain tissue. We investigate the effectiveness of the 2D CNN scheme by comparing its performance against those obtained from another deep learning approach: Deep Boltzmann Machine (DBM), two conventional machine learning approaches: Support Vector Machine (SVM) and Random Forest (RF), and a public toolbox: Lesion Segmentation Tool (LST), all reported to be useful for segmenting WMH in MRI. We also introduce a way to incorporate spatial information in convolution level of CNN for WMH segmentation named global spatial information (GSI). Analysis of covariance corroborated known associations between WMH progression, as assessed by all methods evaluated, and demographic and clinical data. Deep learning algorithms outperform conventional machine learning algorithms by excluding MRI artefacts and pathologies that appear similar to WMH. Our proposed approach of incorporating GSI also successfully helped CNN to achieve better automatic WMH segmentation regardless of network's settings tested. The mean Dice Similarity Coefficient (DSC) values for LST-LGA, SVM, RF, DBM, CNN and CNN-GSI were 0.2963, 0.1194, 0.1633, 0.3264, 0.5359 and 5389 respectively.

[1]  Jeffrey N. Chiang,et al.  Optimized Brain Extraction for Pathological Brains (optiBET) , 2014, PloS one.

[2]  Eleni Sakka,et al.  Interhemispheric characterization of small vessel disease imaging markers after subcortical infarct , 2016, Brain and behavior.

[3]  Zhuo Wang,et al.  Intra-Scanner and Inter-Scanner Reproducibility of Automatic White Matter Hyperintensities Quantification , 2019, Front. Neurosci..

[4]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[5]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[6]  Joanna M. Wardlaw,et al.  Vascular risk factors and progression of white matter hyperintensities in the Lothian Birth Cohort 1936 , 2016, Neurobiology of Aging.

[7]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[8]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[9]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[10]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[11]  Benjamin S. Aribisala,et al.  Morphologic, Distributional, Volumetric, and Intensity Characterization of Periventricular Hyperintensities , 2014, American Journal of Neuroradiology.

[12]  Mark E. Schmidt,et al.  The Alzheimer's Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[13]  Yoshua Bengio,et al.  Equilibrated adaptive learning rates for non-convex optimization , 2015, NIPS.

[14]  Benjamin S Aribisala,et al.  Close Correlation between Quantitative and Qualitative Assessments of White Matter Lesions , 2012, Neuroepidemiology.

[15]  Mariana Leite,et al.  Etiology-based classification of brain white matter hyperintensity on magnetic resonance imaging , 2015, Journal of medical imaging.

[16]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  Vijaya L. Melnick,et al.  Alzheimer’s Dementia , 1985, Contemporary Issues in Biomedicine, Ethics, and Society.

[18]  D. Louis Collins,et al.  Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging , 2013, Medical Image Anal..

[19]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[22]  Bernhard Hemmer,et al.  An automated tool for detection of FLAIR-hyperintense white-matter lesions in Multiple Sclerosis , 2012, NeuroImage.

[23]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[24]  L. Settas,et al.  Demyelination in rheumatic diseases , 2006, Journal of Neurology, Neurosurgery & Psychiatry.

[25]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[26]  Joanna M. Wardlaw,et al.  A comparison of location of acute symptomatic vs. ‘silent’ small vessel lesions , 2015, International journal of stroke : official journal of the International Stroke Society.

[27]  J. Whitwell,et al.  Alzheimer's disease neuroimaging , 2018, Current opinion in neurology.

[28]  Nico Karssemeijer,et al.  Deep multi-scale location-aware 3D convolutional neural networks for automated detection of lacunes of presumed vascular origin , 2016, NeuroImage: Clinical.

[29]  Yoshua Bengio,et al.  Classification using discriminative restricted Boltzmann machines , 2008, ICML '08.

[30]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[31]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[33]  Kiseon Kim,et al.  Convolutional-Neural Network-Based Image Crowd Counting: Review, Categorization, Analysis, and Performance Evaluation , 2019, Sensors.

[34]  Stefan Klöppel,et al.  A comparison of different automated methods for the detection of white matter lesions in MRI data , 2011, NeuroImage.

[35]  Jayaram K. Udupa,et al.  New variants of a method of MRI scale standardization , 2000, IEEE Transactions on Medical Imaging.

[36]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[37]  Refaat E Gabr,et al.  Are multi-contrast magnetic resonance images necessary for segmenting multiple sclerosis brains? A large cohort study based on deep learning. , 2020, Magnetic resonance imaging.

[38]  Christos Davatzikos,et al.  Computer-assisted Segmentation of White Matter Lesions in 3d Mr Images Using Support Vector Machine 1 , 2022 .

[39]  L. Fried,et al.  Clinical correlates of white matter findings on cranial magnetic resonance imaging of 3301 elderly people. The Cardiovascular Health Study. , 1996, Stroke.

[40]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[41]  Peter A. Calabresi,et al.  A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions , 2010, NeuroImage.

[42]  Sterling C. Johnson,et al.  Regional white matter hyperintensities: aging, Alzheimer's disease risk, and cognitive function , 2014, Neurobiology of Aging.

[43]  Liang Xiao,et al.  Automatic Segmentation of White Matter Lesions Using SVM and RSF Model in Multi-channel MRI , 2015, ICIG.

[44]  Steven C. R. Williams,et al.  Meta-analysis, database, and meta-regression of 98 structural imaging studies in bipolar disorder. , 2008, Archives of general psychiatry.

[45]  Jürgen Schmidhuber,et al.  Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation , 2015, NIPS.

[46]  J. Wang,et al.  Convolutional Neural Network for Automated FLAIR Lesion Segmentation on Clinical Brain MR Imaging , 2019, American Journal of Neuroradiology.

[47]  Kotagiri Ramamohanarao,et al.  Automatic white matter lesion segmentation using contrast enhanced FLAIR intensity and Markov Random Field , 2015, Comput. Medical Imaging Graph..

[48]  April Khademi,et al.  Robust White Matter Lesion Segmentation in FLAIR MRI , 2012, IEEE Transactions on Biomedical Engineering.

[49]  A. Alavi,et al.  MR signal abnormalities at 1.5 T in Alzheimer's dementia and normal aging. , 1987, AJR. American journal of roentgenology.

[50]  Y. Ge Multiple sclerosis: the role of MR imaging. , 2006, AJNR. American journal of neuroradiology.

[51]  P. Videbech MRI findings in patients with affective disorder: a meta‐analysis , 1997, Acta psychiatrica Scandinavica.

[52]  Sterling C. Johnson,et al.  Extracting and summarizing white matter hyperintensities using supervised segmentation methods in Alzheimer's disease risk and aging studies , 2014, Human brain mapping.

[53]  Jitendra Malik,et al.  Textons, contours and regions: cue integration in image segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[54]  J. MacFall,et al.  Classification of White Matter Lesions on Magnetic Resonance Imaging in Elderly Persons , 2008, Biological Psychiatry.

[55]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[56]  P. Scheltens,et al.  A semiquantative rating scale for the assessment of signal hyperintensities on magnetic resonance imaging , 1993, Journal of the Neurological Sciences.

[57]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[58]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[59]  Taku Komura,et al.  Evaluation of Four Supervised Learning Schemes in White Matter Hyperintensities Segmentation in Absence or Mild Presence of Vascular Pathology , 2017, MIUA.

[60]  Joanna M Wardlaw,et al.  What are White Matter Hyperintensities Made of? , 2015, Journal of the American Heart Association.

[61]  F. Barkhof,et al.  Accurate white matter lesion segmentation by k nearest neighbor classification with tissue type priors (kNN-TTPs)☆ , 2013, NeuroImage: Clinical.

[62]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[63]  Nick C Fox,et al.  Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration , 2013, The Lancet Neurology.

[64]  Mark E. Schmidt,et al.  The Alzheimer’s Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[65]  Robert Barber,et al.  A neuropathological study of periventricular white matter hyperintensities in major depression. , 2003, Journal of affective disorders.

[66]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[67]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[68]  Daoqiang Zhang,et al.  Hierarchical Ensemble of Multi-level Classifiers for Diagnosis of Alzheimer's Disease , 2012, MLMI.

[69]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[70]  D. Louis Collins,et al.  Evaluating intensity normalization on MRIs of human brain with multiple sclerosis , 2011, Medical Image Anal..

[71]  Harris Drucker,et al.  Comparison of learning algorithms for handwritten digit recognition , 1995 .

[72]  L. Bottou,et al.  COMPARISON OF LEARNING ALGORITHMS FOR , 1995 .

[73]  Paolo Perrotta,et al.  Automatic Detection of White Matter Hyperintensities in Healthy Aging and Pathology Using Magnetic Resonance Imaging: A Review , 2015, Neuroinformatics.

[74]  Rasmus Larsen,et al.  An Ensemble of 2D Convolutional Neural Networks for Tumor Segmentation , 2015, SCIA.

[75]  Karen J. Ferguson,et al.  New multispectral MRI data fusion technique for white matter lesion segmentation: method and comparison with thresholding in FLAIR images , 2010, European Radiology.

[76]  Fuqiang Gao,et al.  Dynamic Progression of White Matter Hyperintensities in Alzheimer’s Disease and Normal Aging: Results from the Sunnybrook Dementia Study , 2016, Front. Aging Neurosci..

[77]  Refaat E Gabr,et al.  Deep Learning for Predicting Enhancing Lesions in Multiple Sclerosis from Noncontrast MRI. , 2019, Radiology.

[78]  Shaohua Kevin Zhou,et al.  Cross-Domain Synthesis of Medical Images Using Efficient Location-Sensitive Deep Network , 2015, MICCAI.

[79]  Robert Barber,et al.  Ischemic basis for deep white matter hyperintensities in major depression: a neuropathological study. , 2002, Archives of general psychiatry.