Intraobserver and interobserver variability in schemes for estimating volume of brain lesions on MR images in multiple sclerosis.

PURPOSE Our goal was to evaluate the intraobserver and interobserver reproducibility of measurements of brain lesion load in multiple sclerosis (MS) by using two proposed acquisition schemes. METHODS Three-millimeter-thick conventional spin-echo (CSE) and fast fluid-attenuated inversion-recovery (FLAIR) sequences were obtained and the lesions segmented using a semiautomated technique based on local thresholding to calculate intraobserver and interobserver reproducibility. These were compared with images obtained from two separate MR units in which 5-mm CSE sequences were obtained and segmented by using the local thresholding technique and also by manual outlining. RESULTS The intraobserver coefficient of variation was 4.0% (95% confidence interval [CI], 3.0% to 4.5%) for the 5-mm CSE sequence measured with manual outlining, 3.1% (95% CI, 2.5% to 3.2%) and 5.1% (95% CI, 4.1% to 5.6%) for the two sets of 5-mm CSE sequences measured using the local thresholding technique, 5.7% (95% CI, 3.9% to 6.6%) for the 3-mm CSE sequence, and 2.6% (95% CI, 2.1% to 2.7%) for the fast FLAIR sequence. The interobserver coefficient of variation was 7.1% (95% CI, 4.9% to 8.7%) and 8.3% (95% CI, 6.4% to 9.6%) for the two sets of 5-mm CSE sequences, 7.3% (95% CI, 4.7% to 9.1%) for the 3-mm CSE sequence, and 2.9% (95% CI, 2.3% to 3.3%) for the fast FLAIR sequence. The intraobserver and interobserver reproducibility of measurements obtained with the fast FLAIR technique was significantly better than those obtained with the other techniques. CONCLUSIONS Our data indicate that the intraobserver and interobserver variability in quantifying MS lesions can be reduced significantly with the use of fast FLAIR sequences, while no significant improvement is gained by reducing the section thickness from 5 mm to 3 mm.

[1]  F. Barkhof,et al.  Interscanner variation in brain MRI lesion load measurements in MS: Implications for clinical trials , 1997, Neurology.

[2]  M. Rovaris,et al.  Sensitivity and Reproducibility of Fast‐FLAIR, FSE, and TGSE Sequences for the MRI Assessment of Brain Lesion Load in Multiple Sclerosis: A Preliminary Study , 1997, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[3]  L Bozzao,et al.  Fast spin-echo and fast fluid-attenuated inversion-recovery versus conventional spin-echo sequences for MR quantification of multiple sclerosis lesions. , 1997, AJNR. American journal of neuroradiology.

[4]  A comparison of conventional and fast spin-echo sequences for the measurement of lesion load in multiple sclerosis using a semi-automated contour technique , 1997, Neuroradiology.

[5]  C Becker,et al.  Quantitative assessment of MRI lesion load in multiple sclerosis. A comparison of conventional spin-echo with fast fluid-attenuated inversion recovery. , 1996, Brain : a journal of neurology.

[6]  F. Barkhof,et al.  Guidelines for the use of magnetic resonance techniques in monitoring the treatment of multiple sclerosis , 1996, Annals of neurology.

[7]  G. Barker,et al.  Quantification of MRI lesion load in multiple sclerosis: a comparison of three computer-assisted techniques. , 1996, Magnetic resonance imaging.

[8]  M. Horsfield,et al.  Quantitative assessment of MRI lesion load in monitoring the evolution of multiple sclerosis. , 1995, Brain : a journal of neurology.

[9]  M. Horsfield,et al.  Intra- and inter-observer agreement of brain MRI lesion volume measurements in multiple sclerosis. A comparison of techniques. , 1995, Brain : a journal of neurology.

[10]  G. Comi,et al.  Resolution‐dependent estimates of lesion volumes in magnetic resonance imaging studies of the brain in multiple sclerosis , 1995, Annals of neurology.

[11]  H. Tobi,et al.  Correlating MRI and clinical disease activity in multiple sclerosis , 1995, Neurology.

[12]  W G Bradley,et al.  Suspected multiple sclerosis: MR imaging with a thin-section fast FLAIR pulse sequence. , 1995, Radiology.

[13]  D. Li,et al.  Magnetic resonance imaging in the evaluation of clinical trials in multiple sclerosis , 1994, Annals of neurology.

[14]  A. Thompson,et al.  Magnetic resonance imaging in monitoring the treatment of multiple sclerosis: concerted action guidelines. , 1991, Journal of neurology, neurosurgery, and psychiatry.

[15]  J Hennig,et al.  RARE imaging: A fast imaging method for clinical MR , 1986, Magnetic resonance in medicine.

[16]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[17]  D. Silberberg,et al.  New diagnostic criteria for multiple sclerosis: Guidelines for research protocols , 1983, Annals of neurology.

[18]  B. L. Welch ON THE COMPARISON OF SEVERAL MEAN VALUES: AN ALTERNATIVE APPROACH , 1951 .