Manual, semi-automated, and automated delineation of chronic brain lesions: A comparison of methods

The exact delineation of chronic brain lesions is a crucial step when investigating the relationship between brain structure and (dys-)function. For this, manual tracing, although very time-consuming, is still the gold standard. In order to assess the possible contributions from other methods, we compared manual tracing of lesion boundaries with a newly developed semi-automated and a fully automated approach for lesion definition in a sample of chronic stroke patients (n=11, 5m, median age 12, range 10-30years). Manual tracing requires substantially more human input (4.8-9.6h/subject) than semi-automated (24.9min/subject) and automated processing (1min/subject). When compared with manual tracing as the gold standard, both the semi-automated (tested with 4 different smoothing filters) and the automated approach towards lesion definition performed on an acceptable level, with an average Dice's similarity index of .53-.60 (semi-automated) and .49 (automated processing). In all semi-automated and automated approaches, larger lesions were identified with a significantly higher performance than smaller lesions, as were central versus peripheral voxels, indicating that the surface-to-volume ratio explains this trend. The automated approach failed to identify two lesions. In several cases, indirect lesion effects (such as enlarged ventricles) were detected using the semi-automated or the automated approach. We conclude that manual tracing remains the gold standard for exact lesion delineation, but that semi-automated and automated approaches may be alternatives for larger lesions and/or larger studies. The detection of indirect lesion effects may be another application of such approaches in the future.

[1]  Timothy Edward John Behrens,et al.  Training induces changes in white matter architecture , 2009, Nature Neuroscience.

[2]  Chris Rorden,et al.  An evaluation of traditional and novel tools for lesion behavior mapping , 2009, NeuroImage.

[3]  Joseph Hajnal,et al.  Natural History of Brain Lesions in Extremely Preterm Infants Studied With Serial Magnetic Resonance Imaging From Birth and Neurodevelopmental Assessment , 2006, Pediatrics.

[4]  Chris Rorden,et al.  Improving Lesion-Symptom Mapping , 2007, Journal of Cognitive Neuroscience.

[5]  M. Desmurget,et al.  Contrasting acute and slow-growing lesions: a new door to brain plasticity. , 2006, Brain : a journal of neurology.

[6]  Meritxell Bach Cuadra,et al.  Comparison and validation of tissue modelization and statistical classification methods in T1-weighted MR brain images , 2005, IEEE Transactions on Medical Imaging.

[7]  Eric J. Pauwels,et al.  Automatic Interpretation Based on Robust Segmentation and Shape-Extraction , 1999, VISUAL.

[8]  Lesley K. Fellows,et al.  Method Matters: An Empirical Study of Impact in Cognitive Neuroscience , 2005, Journal of Cognitive Neuroscience.

[9]  Marko Wilke,et al.  LI-tool: A new toolbox to assess lateralization in functional MR-data , 2007, Journal of Neuroscience Methods.

[10]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[11]  R. Banati.  Brain plasticity and microglia: is transsynaptic glial activation in the thalamus after limb denervation linked to cortical plasticity and central sensitisation? , 2002, Journal of Physiology-Paris.

[12]  C. Lim.  Magnetic resonance imaging findings in bilateral basal ganglia lesions. , 2009, Annals of the Academy of Medicine, Singapore.

[13]  Chris Rorden,et al.  Spatial Normalization of Brain Images with Focal Lesions Using Cost Function Masking , 2001, NeuroImage.

[14]  Bogdan Draganski,et al.  Neuroplasticity: Changes in grey matter induced by training , 2004, Nature.

[15]  Karl J. Friston,et al.  A critique of functional localisers , 2006, NeuroImage.

[16]  M. Buchsbaum,et al.  Deformation-Based Morphometry and Its Relation to Conventional Volumetry of Brain Lateral Ventricles in MRI , 2001, NeuroImage.

[17]  J. Ashburner,et al.  Nonlinear spatial normalization using basis functions , 1999, Human brain mapping.

[18]  Karl J. Friston,et al.  Spatial normalization of lesioned brains: Performance evaluation and impact on fMRI analyses , 2007, NeuroImage.

[19]  Lutz Jäncke,et al.  A voxel-based approach to gray matter asymmetries , 2004, NeuroImage.

[20]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[21]  C. Kennard,et al.  The anatomy of visual neglect , 2003 .

[22]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[23]  Vincent Schmithorst,et al.  A combined bootstrap/histogram analysis approach for computing a lateralization index from neuroimaging data , 2006, NeuroImage.

[24]  Aamer Aziz,et al.  Quantitative analysis of brain asymmetry by using the divergence measure: normal-pathological brain discrimination. , 2006, Academic radiology.

[25]  J. Ashburner,et al.  Multimodal Image Coregistration and Partitioning—A Unified Framework , 1997, NeuroImage.

[26]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[27]  A. Achiron,et al.  Brain MRI lesion load quantification in multiple sclerosis: a comparison between automated multispectral and semi-automated thresholding computer-assisted techniques. , 2002, Magnetic resonance imaging.

[28]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[29]  J André Knottnerus,et al.  Evidence base of clinical diagnosis Evaluation of diagnostic procedures , 2022 .

[30]  H. Karnath,et al.  Using human brain lesions to infer function: a relic from a past era in the fMRI age? , 2004, Nature Reviews Neuroscience.

[31]  A Schulze-Bonhage,et al.  Automated detection of gray matter malformations using optimized voxel-based morphometry: a systematic approach , 2003, NeuroImage.

[32]  S. Berweck,et al.  Do patients with congenital hemiparesis and ipsilateral corticospinal projections respond differently to constraint‐induced movement therapy? , 2008, Developmental medicine and child neurology.

[33]  A. Galaburda,et al.  Topographical variation of the human primary cortices: implications for neuroimaging, brain mapping, and neurobiology. , 1993, Cerebral cortex.

[34]  C. Urgesi,et al.  The Neural Basis of Body Form and Body Action Agnosia , 2008, Neuron.

[35]  Ayse Pinar Saygin,et al.  Lesion correlates of conversational speech production deficits , 2007, Neuropsychologia.

[36]  Andrew A Renshaw,et al.  Increasing cytotechnologist workload above 100 slides per day using the ThinPrep imaging system leads to significant reductions in screening accuracy , 2010, Cancer Cytopathology.

[37]  S. Berweck,et al.  Cortical Neuromodulation by Constraint-Induced Movement Therapy in Congenital Hemiparesis: An fMRI Study , 2007, Neuropediatrics.

[38]  Wolfgang Grodd,et al.  Somatosensory system in two types of motor reorganization in congenital hemiparesis: Topography and function , 2009, Human brain mapping.

[39]  Martin Staudt,et al.  Brain plasticity following early life brain injury: insights from neuroimaging. , 2010, Seminars in perinatology.

[40]  Wolfgang Grodd,et al.  Right-Hemispheric Organization of Language Following Early Left-Sided Brain Lesions: Functional MRI Topography , 2002, NeuroImage.

[41]  V. Brodbeck,et al.  Motor cortex plasticity in ischemic perinatal stroke: a transcranial magnetic stimulation and functional MRI study. , 2009, Pediatric neurology.

[42]  Derek K. Jones,et al.  The effect of filter size on VBM analyses of DT-MRI data , 2005, NeuroImage.

[43]  Frederik Barkhof,et al.  Imaging of White Matter Lesions , 2002, Cerebrovascular Diseases.

[44]  J. Pruim,et al.  Acute effects of thalamotomy and pallidotomy on regional cerebral metabolism, evaluated by PET , 2000, Clinical Neurology and Neurosurgery.

[45]  M. Perenin,et al.  Cortical control of visually guided reaching: evidence from patients with optic ataxia. , 2005, Cerebral cortex.

[46]  Marko Wilke,et al.  Voxel-based morphometry in the detection of dysplasia and neoplasia in childhood epilepsy: Combined grey/white matter analysis augments detection , 2007, Epilepsy Research.

[47]  Scott Holland,et al.  Template-O-Matic: A toolbox for creating customized pediatric templates , 2008, NeuroImage.

[48]  Saara Totterman,et al.  Accuracy and reproducibility of manual and semiautomated quantification of MS lesions by MRI , 2003, Journal of magnetic resonance imaging : JMRI.

[49]  T. Micceri.  The unicorn, the normal curve, and other improbable creatures. , 1989 .

[50]  F. Dick,et al.  Voxel-based lesion–symptom mapping , 2003, Nature Neuroscience.

[51]  G. A. Young,et al.  Recent Developments in Bootstrap Methodology , 2003 .

[52]  Hermann Ackermann,et al.  The role of the unaffected hemisphere in motor recovery after stroke , 2010, Human brain mapping.

[53]  M. Horsfield,et al.  Intra- and inter-observer agreement of brain MRI lesion volume measurements in multiple sclerosis. A comparison of techniques. , 1995, Brain : a journal of neurology.

[54]  J A Fiez,et al.  Lesion segmentation and manual warping to a reference brain: Intra‐ and interobserver reliability , 2000, Human brain mapping.

[55]  Anil F. Ramlackhansingh,et al.  Lesion identification using unified segmentation-normalisation models and fuzzy clustering , 2008, NeuroImage.