Interscanner variation in brain MRI lesion load measurements in MS: Implications for clinical trials

We evaluated the effect of interscanner variation on brain MRI-measured lesion volumes and measurement reproducibility in MS. Twenty clinically definite MS patients were each scanned on two or three scanners (a total of 14 scanners were used). In addition, a formalin-fixed MS brain was studied on eight scanners from different manufacturers and with different field strengths. For the formalin-fixed MS brain, on each machine we obtained two scans with slice thicknesses of 5 and 3 mm. Only 5-mm-thick slices were obtained from patients. The lesion volume present on each scan was evaluated three times by a single observer in random order, using a local thresholding technique. In two groups of eight patients scanned on machines with different field strengths, the mean lesion volumes present on scans obtained at 1.5 T were significantly higher than those measured on scans obtained with machines operating at 0.5 and 1.0 T (p < 0.01). When a single observer repeatedly evaluated the same scan, a median intraobserver agreement of 98.7%(95% CI, 97.9 to 99.1) was achieved. However, when the observer evaluated the scans from different MRI scanners, the agreement (an interscanner agreement) fell to 91.1% (CI, 90.2 to 94.1). When only scanners operating at 1.5 T were considered, the median interscanner agreement was 96.7% (CI, 95 to 97.5). Also, for the formalin-fixed MS brain, the intraobserver agreements obtained with both slice thicknesses were significantly higher than the corresponding interscanner agreements. The interscanner agreement, but not the intraobserver agreement, obtained with a slice thickness of 3 mm was higher than that obtained with a slice thickness of 5 mm. Our results indicate that lesion volume measurements in MS are influenced significantly by the use of different MR scanners and that a patient included in a serial study should be always scanned with the same MR machine using 3-mm thick slices.

[1]  K. Kieburtz Policies on reporting clinical trials and publishing supplements , 1997, Neurology.

[2]  M Filippi,et al.  The effect of imprecise repositioning on lesion volume measurements in patients with multiple sclerosis , 1997, Neurology.

[3]  Ludwig Kappos,et al.  Strategies for optimizing MRI techniques aimed at monitoring disease activity in multiple sclerosis treatment trials , 1997, Journal of Neurology.

[4]  P S Tofts,et al.  An oblique cylinder contrast-adjusted (OCCA) phantom to measure the accuracy of MRI brain lesion volume estimation schemes in multiple sclerosis. , 1997, Magnetic resonance imaging.

[5]  C. Cunningham-Rundles,et al.  Encephalomyelitis in primary hypogammaglobulinaemia. , 1996, Brain : a journal of neurology.

[6]  C Becker,et al.  Quantitative assessment of MRI lesion load in multiple sclerosis. A comparison of conventional spin-echo with fast fluid-attenuated inversion recovery. , 1996, Brain : a journal of neurology.

[7]  F. Barkhof,et al.  Guidelines for the use of magnetic resonance techniques in monitoring the treatment of multiple sclerosis , 1996, Annals of neurology.

[8]  M. Horsfield,et al.  Quantitative assessment of MRI lesion load in monitoring the evolution of multiple sclerosis. , 1995, Brain : a journal of neurology.

[9]  M. Horsfield,et al.  Intra- and inter-observer agreement of brain MRI lesion volume measurements in multiple sclerosis. A comparison of techniques. , 1995, Brain : a journal of neurology.

[10]  G. Comi,et al.  Resolution‐dependent estimates of lesion volumes in magnetic resonance imaging studies of the brain in multiple sclerosis , 1995, Annals of neurology.

[11]  P. S. Albert,et al.  Changes in the amount of diseased white matter over time in patients with relapsing-remitting multiple sclerosis , 1995, Neurology.

[12]  L. Kappos,et al.  Proton MRS of Gadolinium‐enhancing MS Plaques and Metabolic Changes in Normal‐Appearing White Matter , 1995, Magnetic resonance in medicine.

[13]  M Filippi,et al.  A Magnetization Transfer Imaging Study of Normal-Appearing White Matter in Multiple Sclerosis , 1995, Neurology.

[14]  John R. Hodges,et al.  Progressive prosopagnosia associated with selective right temporal lobe atrophy. A new syndrome? , 1995, Brain : a journal of neurology.

[15]  Jia Newcombe,et al.  High Resolution Proton NMR Spectroscopy of Multiple Sclerosis Lesions , 1995, Journal of neurochemistry.

[16]  L. Garrido,et al.  Migration and Accumulation of Silicone in the Liver of Women with Silicone Gel‐Filled Breast Implants , 1995, Magnetic resonance in medicine.

[17]  R. Rosenberg Autosomal dominant cerebellar phenotypes , 1990, Neurology.

[18]  M. Eliasziw,et al.  MR imaging field strength: prospective evaluation of the diagnostic accuracy of MR for diagnosis of multiple sclerosis at 0.5 and 1.5 T. , 1995, Radiology.

[19]  S. Atlas MR angiography in neurologic disease. , 1994, Radiology.

[20]  R C Grimm,et al.  Initial clinical experience in MR imaging of the brain with a fast fluid-attenuated inversion-recovery pulse sequence. , 1994, Radiology.

[21]  D. Li,et al.  Magnetic resonance imaging in the evaluation of clinical trials in multiple sclerosis , 1994, Annals of neurology.

[22]  Benoit M. Dawant,et al.  Correction of intensity variations in MR images for computer-aided tissue classification , 1993, IEEE Trans. Medical Imaging.

[23]  T A Spraggins,et al.  T2‐weighted three‐dimensional MP‐RAGE MR imaging , 1991, Journal of magnetic resonance imaging : JMRI.

[24]  A. Thompson,et al.  Magnetic resonance imaging in monitoring the treatment of multiple sclerosis: concerted action guidelines. , 1991, Journal of neurology, neurosurgery, and psychiatry.

[25]  P. Ell,et al.  99TCm-HMPAO SPECT studies in traumatic intracerebral haematoma. , 1991, Journal of neurology, neurosurgery, and psychiatry.

[26]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[27]  R. Henkelman Measurement of signal intensities in the presence of noise in MR images. , 1985, Medical physics.

[28]  J. Kurtzke Rating neurologic impairment in multiple sclerosis , 1983, Neurology.

[29]  D. Silberberg,et al.  New diagnostic criteria for multiple sclerosis: Guidelines for research protocols , 1983, Annals of neurology.

[30]  J. Ebersole,et al.  An evaluation of ambulatory, cassette EEG monitoring , 1983, Neurology.

[31]  M. Raichle The pathophysiology of brain ischemia , 1983, Annals of neurology.

[32]  B. L. Welch ON THE COMPARISON OF SEVERAL MEAN VALUES: AN ALTERNATIVE APPROACH , 1951 .