Structured Learning for 3-D Perivascular Space Segmentation Using Vascular Features

Objective: The goal of this paper is to automatically segment perivascular spaces (PVSs) in brain from high-resolution 7T magnetic resonance (MR) images. Methods: We propose a structured-learning-based segmentation framework to extract the PVSs from high-resolution 7T MR images. Specifically, we integrate three types of vascular filter responses into a structured random forest for classifying voxels into two categories, i.e., PVS and background. In addition, we propose a novel entropy-based sampling strategy to extract informative samples in the background for training an explicit classification model. Since the vascular filters can extract various vascular features, even thin and low-contrast structures can be effectively extracted from noisy backgrounds. Moreover, continuous and smooth segmentation results can be obtained by utilizing patch-based structured labels. Results: The performance of our proposed method is evaluated on 19 subjects with 7T MR images, with the Dice similarity coefficient reaching 66%. Conclusion: The joint use of entropy-based sampling strategy, vascular features, and structured learning can improve the segmentation accuracy. Significance: Instead of manual annotation, our method provides an automatic way for PVS segmentation. Moreover, our method can be potentially used for other vascular structure segmentation because of its data-driven property.

[1]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[2]  Karen J. Ferguson,et al.  Enlarged perivascular spaces are associated with cognitive function in healthy elderly men , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[3]  J. Mugler,et al.  Three‐dimensional magnetization‐prepared rapid gradient‐echo imaging (3D MP RAGE) , 1990, Magnetic resonance in medicine.

[4]  Gábor Székely,et al.  Joint 3-D vessel segmentation and centerline extraction using oblique Hough forests with steerable filters , 2015, Medical Image Anal..

[5]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[6]  Nick C Fox,et al.  Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration , 2013, The Lancet Neurology.

[7]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[8]  R O Weller,et al.  Interrelationships of the pia mater and the perivascular (Virchow-Robin) spaces in the human cerebrum. , 1990, Journal of anatomy.

[9]  W. Chen,et al.  Assessment of the Virchow-Robin Spaces in Alzheimer Disease, Mild Cognitive Impairment, and Normal Aging, Using High-Field MR Imaging , 2011, American Journal of Neuroradiology.

[10]  F. Paul,et al.  Perivascular spaces--MRI marker of inflammatory activity in the brain? , 2008, Brain : a journal of neurology.

[11]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Changyan Xiao,et al.  Pulmonary Fissure Detection in CT Images Using a Derivative of Stick Filter , 2016, IEEE Transactions on Medical Imaging.

[14]  Jun Zhang,et al.  Continuous rotation invariant local descriptors for texton dictionary-based texture classification , 2013, Comput. Vis. Image Underst..

[15]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Nathalie Boddaert,et al.  MRI Findings in 77 Children with Non-Syndromic Autistic Disorder , 2009, PloS one.

[17]  Dinggang Shen,et al.  Visualization of perivascular spaces in the human brain at 7T: sequence optimization and morphology characterization , 2016, NeuroImage.

[18]  Richard P. Wildes,et al.  Spacetime Texture Representation and Recognition Based on a Spatiotemporal Orientation Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Nikos Paragios,et al.  Globally Optimal Active Contours, Sequential Monte Carlo and On-Line Learning for Vessel Segmentation , 2006, ECCV.

[20]  Fuqiang Gao,et al.  Visible Virchow-Robin spaces on magnetic resonance imaging of Alzheimer's disease patients and normal elderly from the Sunnybrook Dementia Study. , 2014, Journal of Alzheimer's disease : JAD.

[21]  Jean-Claude Baron,et al.  Enlarged perivascular spaces as a marker of underlying arteriopathy in intracerebral haemorrhage: a multicentre MRI cohort study , 2013, Journal of Neurology, Neurosurgery & Psychiatry.

[22]  H. Fujita,et al.  Computer-aided diagnosis scheme for classification of lacunar infarcts and enlarged Virchow-Robin spaces in brain MR images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  R. Rouhl,et al.  Virchow-Robin spaces relate to cerebral small vessel disease severity , 2008, Journal of Neurology.

[24]  Konstantinos G. Derpanis,et al.  Three-dimensional nth derivative of Gaussian separable steerable filters , 2005, IEEE International Conference on Image Processing 2005.

[25]  I. Deary,et al.  Towards the automatic computational assessment of enlarged perivascular spaces on brain magnetic resonance images: A systematic review , 2013, Journal of magnetic resonance imaging : JMRI.

[26]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[27]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[28]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  R. Busse,et al.  Fast spin echo sequences with very long echo trains: Design of variable refocusing flip angle schedules and generation of clinical T2 contrast , 2006, Magnetic resonance in medicine.

[30]  Mojtaba Akbari,et al.  Features of Virchow-Robin spaces in newly diagnosed multiple sclerosis patients. , 2011, European journal of radiology.

[31]  Jun Zhang,et al.  Local Energy Pattern for Texture Classification Using Self-Adaptive Quantization Thresholds , 2013, IEEE Transactions on Image Processing.

[32]  Fuqiang Gao,et al.  Virchow-Robin Spaces: Correlations with Polysomnography-Derived Sleep Parameters. , 2015, Sleep.

[33]  M. Esiri,et al.  Immunological and neuropathological significance of the Virchow-Robin space , 1990, Journal of the Neurological Sciences.

[34]  Xavier Descombes,et al.  An object-based approach for detecting small brain lesions: application to Virchow-Robin spaces , 2004, IEEE Transactions on Medical Imaging.

[35]  B. Mazoyer,et al.  Severity of Dilated Virchow-Robin Spaces Is Associated With Age, Blood Pressure, and MRI Markers of Small Vessel Disease: A Population-Based Study , 2010, Stroke.

[36]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[37]  Elisa Ricci,et al.  Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification , 2007, IEEE Transactions on Medical Imaging.

[38]  B Mazoyer,et al.  Frequency and Location of Dilated Virchow-Robin Spaces in Elderly People: A Population-Based 3D MR Imaging Study , 2011, American Journal of Neuroradiology.

[39]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[40]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[41]  A. Osareh,et al.  Vessel Segmentation in Retinal Images Using Multi-scale Line Operator and K-Means Clustering , 2014, Journal of medical signals and sensors.

[42]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[43]  Keshab K. Parhi,et al.  Iterative Vessel Segmentation of Fundus Images , 2015, IEEE Transactions on Biomedical Engineering.

[44]  Stavros Stivaros,et al.  Potential surrogate markers of cerebral microvascular angiopathy in asymptomatic subjects at risk of stroke , 2009, European Radiology.