Reproducibility of High-Resolution MRI for the Identification and the Quantification of Carotid Atherosclerotic Plaque Components: Consequences for Prognosis Studies and Therapeutic Trials

Background and Purpose— Although MRI is increasingly proposed to investigate composition of carotid atherosclerosis, its reproducibility has rarely been addressed. We assessed the reproducibility of MRI for the identification and quantification of carotid atherosclerotic plaque components. Methods— Using published criteria, 2 readers independently analyzed the carotid MRI (1.5-T MR units with a 4-channel phased-array surface coil, Machnet) of 85 consecutive patients with symptomatic (40% to 69% according to NASCET method) or asymptomatic (60% or greater) carotid artery stenosis enrolled in an ongoing prognostic study. One reader reevaluated all images. Fibrous cap was also secondarily identified independently on T2-weighted and time-of-flight (TOF) images. Results— Intraobserver agreement was substantial for the identification of calcifications (kappa [&kgr;]=0.70; 95% CI: 0.54 to 0.86) and lipid-rich/necrotic core (LR/NC) (&kgr;=0.69; 0.31 to 0.86), almost perfect for hemorrhages (&kgr;=0.82; 0.68 to 0.96), and moderate (&kgr;=0.58; 0.27 to 0.88) and fair (&kgr;=0.33; 0.09 to 0.56) for fibrous cap identification on T2-weighted and TOF images, respectively. Interobserver agreement was substantial for the identification of calcifications (&kgr;=0.74; 0.59 to 0.89) and hemorrhages (&kgr;=0.62; 0.43 to 0.81), and moderate for LR/NC (&kgr;=0.58; 0.20 to 0.95). Agreement was fair for fibrous cap identification on both T2-weighted (&kgr;=0.28; −0.03 to 0.59) and on TOF images (&kgr;=0.26; 0.04 to 0.48). Agreement between T2 and TOF images for fibrous cap identification was slight (&kgr;=0.16; 0.01 to 0.31). Intra- and interobserver reproducibility for quantitative area measurements of vessel, lumen, plaque, LR/NC, and fibrous components was high with intraclass correlation coefficients ranging from 0.73 to 0.99. However, for the LR/NC, the interval delimited by the Bland-Altman graphs was wide in comparison to the mean. Conclusions— Vessel and plaque quantification is reproducible. Reproducibility of MRI for identifying and quantifying carotid plaque components is overall acceptable, but there is still significant variability that should be taken into account in the design of prognosis studies and clinical trials. Reproducibility for fibrous cap identification needs to be improved.

[1]  Brian K. Rutt,et al.  Validation of Automatically Classified Magnetic Resonance Images for Carotid Plaque Compositional Analysis , 2006, Stroke.

[2]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[3]  A Donner,et al.  A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. , 1992, Statistics in medicine.

[4]  Cheuk Y. Tang,et al.  Quantification of human atherosclerotic plaques using spatially enhanced cluster analysis of multicontrast‐weighted magnetic resonance images , 2004, Magnetic resonance in medicine.

[5]  Chun Yuan,et al.  Association Between Carotid Plaque Characteristics and Subsequent Ischemic Cerebrovascular Events: A Prospective Assessment With MRI—Initial Results , 2006, Stroke.

[6]  E. Kazerooni,et al.  Population and sample. , 2001, AJR. American journal of roentgenology.

[7]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[8]  V. Fuster,et al.  Effects of aggressive versus conventional lipid-lowering therapy by simvastatin on human atherosclerotic lesions: a prospective, randomized, double-blind trial with high-resolution magnetic resonance imaging. , 2005, Journal of the American College of Cardiology.

[9]  M. McConnell,et al.  Multicontrast black‐blood MRI of carotid arteries: Comparison between 1.5 and 3 tesla magnetic field strengths , 2006, Journal of magnetic resonance imaging : JMRI.

[10]  C Yuan,et al.  Measurement of atherosclerotic carotid plaque size in vivo using high resolution magnetic resonance imaging. , 1998, Circulation.

[11]  C. Yuan,et al.  Visualization of Fibrous Cap Thickness and Rupture in Human Atherosclerotic Carotid Plaque In Vivo With High-Resolution Magnetic Resonance Imaging , 2000, Circulation.

[12]  Chun Yuan,et al.  Classification of Human Carotid Atherosclerotic Lesions With In Vivo Multicontrast Magnetic Resonance Imaging , 2002, Circulation.

[13]  M. Cowan,et al.  American Heart Association. , 2018, P & T : a peer-reviewed journal for formulary management.

[14]  P. Taylor,et al.  Carotid plaque characterization by duplex scanning: observer error may undermine current clinical trials. , 1999, Stroke.

[15]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[16]  J. Slattery,et al.  Equivalence of Measurements of Carotid Stenosis: A Comparison of Three Methods on 1001 Angiograms , 1994, Stroke.

[17]  P. Rothwell,et al.  Reproducibility of Histological Assessment of Carotid Plaque: Implications for Studies of Carotid Imaging , 2004, Cerebrovascular Diseases.

[18]  V. Fuster,et al.  The diagnostic accuracy of ex vivo MRI for human atherosclerotic plaque characterization. , 1999, Arteriosclerosis, thrombosis, and vascular biology.

[19]  Allan J. Fox,et al.  Significance of Plaque Ulceration in Symptomatic Patients With High‐Grade Carotid Stenosis , 1994, Stroke.

[20]  Peter J. Kirkpatrick,et al.  MRI-derived measurements of fibrous-cap and lipid-core thickness: the potential for identifying vulnerable carotid plaques in vivo , 2004, Neuroradiology.

[21]  R. Balaban,et al.  Carotid artery atherosclerosis: in vivo morphologic characterization with gadolinium-enhanced double-oblique MR imaging initial results. , 2002, Radiology.

[22]  P J Gallagher,et al.  Histological Assessment of 526 Symptomatic Carotid Plaques in Relation to the Nature and Timing of Ischemic Symptoms: The Oxford Plaque Study , 2006, Circulation.

[23]  J. Carlin,et al.  Bias, prevalence and kappa. , 1993, Journal of clinical epidemiology.

[24]  Chun Yuan,et al.  Identification of Fibrous Cap Rupture With Magnetic Resonance Imaging Is Highly Associated With Recent Transient Ischemic Attack or Stroke , 2002, Circulation.

[25]  V. Fuster,et al.  Magnetic resonance images lipid, fibrous, calcified, hemorrhagic, and thrombotic components of human atherosclerosis in vivo. , 1996, Circulation.

[26]  C Yuan,et al.  Closed contour edge detection of blood vessel lumen and outer wall boundaries in black-blood MR images. , 1999, Magnetic resonance imaging.

[27]  Chun Yuan,et al.  Measurement of carotid wall volume and maximum area with contrast-enhanced 3D MR imaging: initial observations. , 2003, Radiology.

[28]  Caroline Reinhold,et al.  Fundamentals of clinical research for radiologists , 2005 .

[29]  References , 1971 .

[30]  C. Yuan,et al.  Quantitative Evaluation of Carotid Plaque Composition by In Vivo MRI , 2004, Arteriosclerosis, thrombosis, and vascular biology.

[31]  C Yuan,et al.  Detection and characterization of atherosclerotic fibrous caps with T2-weighted MR. , 1998, AJNR. American journal of neuroradiology.

[32]  W S Kerwin,et al.  In Vivo Accuracy of Multispectral Magnetic Resonance Imaging for Identifying Lipid-Rich Necrotic Cores and Intraplaque Hemorrhage in Advanced Human Carotid Plaques , 2001, Circulation.

[33]  V. Fuster,et al.  Water diffusion properties of human atherosclerosis and thrombosis measured by pulse field gradient nuclear magnetic resonance. , 1997, Arteriosclerosis, thrombosis, and vascular biology.

[34]  S. L. Bridal,et al.  Characterization of atherosclerotic plaque components by high resolution quantitative MR and US imaging , 1998, Journal of magnetic resonance imaging : JMRI.

[35]  R. Müller,et al.  A critical discussion of intraclass correlation coefficients. , 1994, Statistics in medicine.

[36]  J. Fleiss Statistical methods for rates and proportions , 1974 .

[37]  J. Slattery,et al.  Prognostic Value and Reproducibility of Measurements of Carotid Stenosis: A Comparison of Three Methods on 1001 Angiograms , 1994, Stroke.

[38]  A Tabib,et al.  Atherosclerotic plaques: classification and characterization with T2-weighted high-spatial-resolution MR imaging-- an in vitro study. , 2001, Radiology.

[39]  P. Rothwell,et al.  A Critical Appraisal of the Performance, Reporting, and Interpretation of Studies Comparing Carotid Plaque Imaging With Histology , 2005, Stroke.

[40]  D Saloner,et al.  Structure of Plaque at Carotid Bifurcation: High-Resolution MRI With Histological Correlation , 2001, Stroke.

[41]  P. E. Crewson,et al.  Reader agreement studies. , 2005, AJR. American journal of roentgenology.

[42]  Chun Yuan,et al.  In Vivo Quantitative Measurement of Intact Fibrous Cap and Lipid-Rich Necrotic Core Size in Atherosclerotic Carotid Plaque: Comparison of High-Resolution, Contrast-Enhanced Magnetic Resonance Imaging and Histology , 2005, Circulation.

[43]  V. Fuster,et al.  T2-weighted contrast for NMR characterization of human atherosclerosis. , 1995, Arteriosclerosis, thrombosis, and vascular biology.