Deep multi-scale location-aware 3D convolutional neural networks for automated detection of lacunes of presumed vascular origin

Lacunes of presumed vascular origin (lacunes) are associated with an increased risk of stroke, gait impairment, and dementia and are a primary imaging feature of the small vessel disease. Quantification of lacunes may be of great importance to elucidate the mechanisms behind neuro-degenerative disorders and is recommended as part of study standards for small vessel disease research. However, due to the different appearance of lacunes in various brain regions and the existence of other similar-looking structures, such as perivascular spaces, manual annotation is a difficult, elaborative and subjective task, which can potentially be greatly improved by reliable and consistent computer-aided detection (CAD) routines. In this paper, we propose an automated two-stage method using deep convolutional neural networks (CNN). We show that this method has good performance and can considerably benefit readers. We first use a fully convolutional neural network to detect initial candidates. In the second step, we employ a 3D CNN as a false positive reduction tool. As the location information is important to the analysis of candidate structures, we further equip the network with contextual information using multi-scale analysis and integration of explicit location features. We trained, validated and tested our networks on a large dataset of 1075 cases obtained from two different studies. Subsequently, we conducted an observer study with four trained observers and compared our method with them using a free-response operating characteristic analysis. Shown on a test set of 111 cases, the resulting CAD system exhibits performance similar to the trained human observers and achieves a sensitivity of 0.974 with 0.13 false positives per slice. A feasibility study also showed that a trained human observer would considerably benefit once aided by the CAD system.

[1]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[2]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[3]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  D. Louis Collins,et al.  Application of Information Technology: A Four-Dimensional Probabilistic Atlas of the Human Brain , 2001, J. Am. Medical Informatics Assoc..

[5]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[8]  W. Markesbery,et al.  Brain infarction and the clinical expression of Alzheimer disease. The Nun Study. , 1997, JAMA.

[9]  Lisa Tang,et al.  Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation , 2015, MICCAI.

[10]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[11]  Richard Beare,et al.  Silent Infarcts and Cerebral Microbleeds Modify the Associations of White Matter Lesions With Gait and Postural Stability: Population-Based Study , 2012, Stroke.

[12]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[13]  R F Spetzler,et al.  Incidental subcortical lesions identified on magnetic resonance imaging in the elderly. II. Postmortem pathological correlations. , 1986, Stroke.

[14]  Geoffrey E. Hinton,et al.  Guest Editorial: Deep Learning , 2015, International Journal of Computer Vision.

[15]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[16]  T. Hara,et al.  Improvement of Automated Detection Method of Lacunar Infarcts in Brain MR Images , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Xiangrong Zhou,et al.  Development of an Automated Method for the Detection of Chronic Lacunar Infarct Regions in Brain MR Images , 2007, IEICE Trans. Inf. Syst..

[18]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[19]  Tien Yin Wong,et al.  Multi-stage segmentation of white matter hyperintensity, cortical and lacunar infarcts , 2012, NeuroImage.

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  H. Fujita,et al.  Computer-aided diagnosis scheme for classification of lacunar infarcts and enlarged Virchow-Robin spaces in brain MR images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[23]  J. C. van Swieten,et al.  Residual Lesions on Computed Tomography After Intracerebral Hemorrhage , 1991, Stroke.

[24]  Hiroshi Fujita,et al.  Computer-Aided Diagnosis for Detection of Lacunar Infarcts on MR Images: ROC Analysis of Radiologists’ Performance , 2012, Journal of Digital Imaging.

[25]  Kensuke Yokoi,et al.  APAC: Augmented PAttern Classification with Neural Networks , 2015, ArXiv.

[26]  Nico Karssemeijer,et al.  Small white matter lesion detection in cerebral small vessel disease , 2015, Medical Imaging.

[27]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[28]  Dan Ciresan,et al.  Multi-Column Deep Neural Networks for offline handwritten Chinese character classification , 2013, 2015 International Joint Conference on Neural Networks (IJCNN).

[29]  Neil Roberts,et al.  Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015 , 2015, Lecture Notes in Computer Science.

[30]  Poonam Bhogale,et al.  Brain Tumor Segmentation , 2016 .

[31]  Sebastiaan Overeem,et al.  Risk factors and prognosis of young stroke. The FUTURE study: A prospective cohort study. Study rationale and protocol , 2011, BMC neurology.

[32]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[33]  Nico Karssemeijer,et al.  Non-uniform patch sampling with deep convolutional neural networks for white matter hyperintensity segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[34]  Nick C Fox,et al.  Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration , 2013, The Lancet Neurology.

[35]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[36]  Panteleimon Giannakopoulos,et al.  Differential Impact of Lacunes and Microvascular Lesions on Poststroke Depression , 2009, Stroke.

[37]  Joanna M Wardlaw,et al.  What is a lacune? , 2008, Stroke.

[38]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[39]  H. Fujita,et al.  Computer-aided diagnosis scheme for detection of lacunar infarcts on MR images. , 2007, Academic Radiology.

[40]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[41]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[42]  Ammarin Thakkinstian,et al.  Corticosteroid and antiviral therapy for Bell's palsy: A network meta-analysis , 2011, BMC neurology.

[43]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[44]  A. Hofman,et al.  Silent Brain Infarcts and White Matter Lesions Increase Stroke Risk in the General Population: The Rotterdam Scan Study , 2003, Stroke.

[45]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[47]  Hiroshi Fujita,et al.  Eigenspace Template Matching for Detection of Lacunar Infarcts on MR Images , 2015, Journal of Digital Imaging.

[48]  Max A. Viergever,et al.  Automatic coronary artery calcium scoring in cardiac CT angiography using paired convolutional neural networks , 2016, Medical Image Anal..

[49]  Hiroshi Fujita,et al.  CAD Scheme for differential diagnosis of lacunar infarcts and normal Virchow-Robin spaces on brain MR images , 2009 .

[50]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[51]  Max A. Viergever,et al.  Automatic Coronary Calcium Scoring in Cardiac CT Angiography Using Convolutional Neural Networks , 2015, MICCAI.

[52]  D. Norris,et al.  Causes and consequences of cerebral small vessel disease. The RUN DMC study: a prospective cohort study. Study rationale and protocol , 2011, BMC neurology.

[53]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[54]  M. L. Lauzon,et al.  Cavitation After Acute Symptomatic Lacunar Stroke Depends on Time, Location, and MRI Sequence , 2012, Stroke.

[55]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[56]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[57]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[58]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[59]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[60]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[61]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..