Non-invasive imaging compared with intra-arterial angiography in the diagnosis of symptomatic carotid stenosis: a meta-analysis

BACKGROUND Accurate carotid imaging is important for effective secondary stroke prevention. Non-invasive imaging, now widely available, is replacing intra-arterial angiography for carotid stenosis, but the accuracy remains uncertain despite an extensive literature. We systematically reviewed the accuracy of non-invasive imaging compared with intra-arterial angiography for diagnosing carotid stenosis in patients with carotid territory ischaemic symptoms. METHODS We searched for articles published between 1980 and April 2004; included studies comparing non-invasive imaging with intra-arterial angiography that met Standards for Reporting of Diagnostic Accuracy (STARD) criteria; extracted data to calculate sensitivity and specificity of non-invasive imaging, to test for heterogeneity and to perform sensitivity analyses; and categorised percent stenosis by the North American Symptomatic Carotid Endarterectomy Trial (NASCET) method. RESULTS In 41 included studies (2541 patients, 4876 arteries), contrast-enhanced MR angiography was more sensitive (0.94, 95% CI 0.88-0.97) and specific (0.93, 95% CI 0.89-0.96) for 70-99% stenosis than Doppler ultrasound, MR angiography, and CT angiography (sensitivities 0.89, 0.88, 0.76; specificities 0.84, 0.84, 0.94, respectively). Data for 50-69% stenoses and combinations of non-invasive tests were sparse and unreliable. There was heterogeneity between studies and evidence of publication bias. INTERPRETATION Non-invasive tests, used cautiously, could replace intra-arterial carotid angiography for 70-99% stenosis. However, more data are required to determine their accuracy, especially at 50-69% stenoses where the balance of risk and benefit for carotid endarterectomy is particularly narrow, and to explore and overcome heterogeneity. Methodology for evaluating imaging tests should be improved; blinded, prospective studies in clinically relevant patients are essential basic characteristics.

[1]  D. Haynor,et al.  The Clinical Efficacy of Magnetic Resonance Imaging in Neuroimaging , 1994, Annals of Internal Medicine.

[2]  J. Slattery,et al.  A simple method to improve the accuracy of non-invasive ultrasound in selecting TIA patients for cerebral angiography. , 1990, Journal of neurology, neurosurgery, and psychiatry.

[3]  A. Kleinschmidt,et al.  Between‐Method Correlation in Quantifying Internal Carotid Stenosis , 1993, Stroke.

[4]  Mark Stevenson,et al.  Accurate, practical and cost-effective assessment of carotid stenosis in the UK. , 2006, Health technology assessment.

[5]  S. Pendlebury,et al.  Critical appraisal of the design and reporting of studies of imaging and measurement of carotid stenosis. , 2000, Stroke.

[6]  Kennon Heard,et al.  Emergency medicine animal research: does use of randomization and blinding affect the results? , 2003, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  J. Reed,et al.  Magnetic Resonance Angiography and Duplex Scanning Concordance in Detecting Severe Carotid Stenosis , 1995 .

[8]  P. Nederkoorn,et al.  Diagnostic Performance of Duplex Ultrasound in Patients Suspected of Carotid Artery Disease: The Ipsilateral Versus Contralateral Artery , 2005, Stroke.

[9]  E Berry,et al.  The identification of bias in studies of the diagnostic performance of imaging modalities. , 1997, The British journal of radiology.

[10]  M. Whittle,et al.  Efficacy of screening MR angiography and Doppler ultrasonography in the evaluation of carotid artery stenosis. , 1994, The American surgeon.

[11]  P. Rothwell,et al.  Population-based study of delays in carotid imaging and surgery and the risk of recurrent stroke , 2005, Neurology.

[12]  Paul J. Nederkoorn,et al.  Duplex Ultrasound and Magnetic Resonance Angiography Compared With Digital Subtraction Angiography in Carotid Artery Stenosis: A Systematic Review , 2003, Stroke.

[13]  U. Salvolini,et al.  Spiral CT angiography in the study of the carotid stenoses. , 1997, Journal of neuroradiology. Journal de neuroradiologie.

[14]  P. Turski,et al.  Combined use of duplex imaging and magnetic resonance angiography for evaluation of patients with symptomatic ipsilateral high-grade carotid stenosis. , 1993, Journal of vascular surgery.

[15]  U. Salvolini,et al.  [Stenosis-occlusion of the carotid bifurcation. Angiography with MR and contrast media versus digital angiography]. , 1998, La Radiologia medica.

[16]  R. Pararajasingam,et al.  Carotid Artery Imaging in the United Kingdom: A Postal Questionnaire of Current Practice , 2005, Vascular.

[17]  M. Shroff,et al.  Comparison of MR angiography with contrast angiography for the diagnosis of carotid artery stenosis. , 1995, The Journal of the Association of Physicians of India.

[18]  L Remonda,et al.  Carotid artery stenosis, occlusion, and pseudo-occlusion: first-pass, gadolinium-enhanced, three-dimensional MR angiography--preliminary study. , 1998, Radiology.

[19]  C. Bartolozzi,et al.  Contrast-Enhanced Three-Dimensional Magnetic Resonance Angiography of Atherosclerotic Internal Carotid Stenosis as the Noninvasive Imaging Modality in Revascularization Decision Making , 2003, Stroke.

[20]  P. Bossuyt,et al.  BMC Medical Research Methodology , 2002 .

[21]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[22]  G. Moneta.  Non-invasive imaging compared with intra-arterial angiography in the diagnosis of symptomatic carotid stenosis: a meta-analysis , 2008 .

[23]  Evaluation of carotid stenosis by angiography: potential bias toward overestimated measurements introduced by prior interpretation of Doppler sonograms. , 2000, AJNR. American journal of neuroradiology.

[24]  S. Gutnikov,et al.  From subgroups to individuals: general principles and the example of carotid endarterectomy , 2005, The Lancet.

[25]  J. Fleiss.  Statistical methods for rates and proportions , 1974 .

[26]  R. Edelman,et al.  Preoperative assessment of the carotid bifurcation. Can magnetic resonance angiography and duplex ultrasonography replace contrast arteriography? , 1995, Stroke.

[27]  Markus Horn,et al.  Preoperative evaluation of carotid artery stenosis: comparison of contrast-enhanced MR angiography and duplex sonography with digital subtraction angiography. , 2003, AJNR. American journal of neuroradiology.

[28]  G. Scotti,et al.  Carotid artery stenosis: intraindividual correlations of 3D time-of-flight MR angiography, contrast-enhanced MR angiography, conventional DSA, and rotational angiography for detection and grading. , 2005, Radiology.

[29]  X Leclerc,et al.  Internal carotid arterial stenosis: CT angiography with volume rendering. , 1999, Radiology.

[30]  Juan Alvarez-Linera,et al.  Prospective evaluation of carotid artery stenosis: elliptic centric contrast-enhanced MR angiography and spiral CT angiography compared with digital subtraction angiography. , 2003, AJNR. American journal of neuroradiology.

[31]  S. Gutnikov,et al.  Population-based study of event-rate, incidence, case fatality, and mortality for all acute vascular events in all arterial territories (Oxford Vascular Study) , 2005, The Lancet.

[32]  S. Riederer,et al.  Carotid artery: prospective blinded comparison of two-dimensional time-of-flight MR angiography with conventional angiography and duplex US. , 1993, Radiology.

[33]  J. Wardlaw,et al.  How does the degree of carotid stenosis affect the accuracy and interobserver variability of magnetic resonance angiography? , 2001, Journal of neurology, neurosurgery, and psychiatry.

[34]  J. L. Tang,et al.  Misleading funnel plot for detection of bias in meta-analysis. , 2000, Journal of clinical epidemiology.

[35]  J. Slattery,et al.  Prognostic Value and Reproducibility of Measurements of Carotid Stenosis: A Comparison of Three Methods on 1001 Angiograms , 1994, Stroke.

[36]  J. Brossmann,et al.  Spiral CT angiography and selective digital subtraction angiography of internal carotid artery stenosis. , 1996, AJNR. American journal of neuroradiology.

[37]  U. Salvolini,et al.  MR angiography in carotid stenosis: a comparison of three techniques. , 1998, European journal of radiology.

[38]  D. Kallmes,et al.  Specificity of MR angiography as a confirmatory test of carotid artery stenosis. , 1996, AJNR. American journal of neuroradiology.

[39]  W. Mali,et al.  Multidirectional depiction of internal carotid arterial stenosis: three-dimensional time-of-flight MR angiography versus rotational and conventional digital subtraction angiography. , 2000, Radiology.

[40]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. , 2003, Radiology.

[41]  D. Sackett,et al.  Benefit of carotid endarterectomy in patients with symptomatic moderate or severe stenosis. North American Symptomatic Carotid Endarterectomy Trial Collaborators. , 1998, The New England journal of medicine.

[42]  R. Haynes,et al.  Medline : analytical survey scientifically strong studies of diagnosis from Optimal search strategies for retrieving , 2004 .

[43]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[44]  J. Bamford,et al.  Use of magnetic resonance angiography to select candidates with recently symptomatic carotid stenosis for surgery: systematic review , 2002, BMJ : British Medical Journal.

[45]  G. Donnan,et al.  The Accuracy of Magnetic Resonance Angiography in the Assessment of Extracranial Carotid Artery Occlusive Disease , 1996 .

[46]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[47]  M S van Leeuwen,et al.  CT angiography: application to the evaluation of carotid artery stenosis. , 1993, Radiology.

[48]  Jonathan J Deeks,et al.  Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. , 2001, BMJ.

[49]  R. Vanninen,et al.  Imaging of carotid artery stenosis: clinical efficacy and cost-effectiveness. , 1995, AJNR. American journal of neuroradiology.

[50]  M. Eliasziw,et al.  Analysis of pooled data from the randomised controlled trials of endarterectomy for symptomatic carotid stenosis , 2003, The Lancet.

[51]  L. Knudsen,et al.  Accuracy of duplex scan of internal carotid arteries. , 2002, European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery.

[52]  R J Lilford,et al.  Trials and fast changing technologies: the case for tracker studies , 2000, BMJ : British Medical Journal.

[53]  D. Moher,et al.  Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews , 1996, The Lancet.

[54]  P. Nederkoorn,et al.  Systematic Review of Computed Tomographic Angiography for Assessment of Carotid Artery Disease , 2004, Stroke.

[55]  E. Mori,et al.  Usefulness of Three-Dimensional Time-of-Flight MR Angiography for Evaluation of Carotid Artery Bifurcation Stenosis , 1995 .

[56]  A. Salvian,et al.  New duplex ultrasound scan criteria for managing symptomatic 50% or greater carotid stenosis. , 1999, Journal of vascular surgery.

[57]  Erik Buskens,et al.  Preoperative Diagnosis of Carotid Artery Stenosis: Accuracy of Noninvasive Testing , 2002, Stroke.

[58]  Duplex Criteria for Grading Internal Carotid Artery Stenosis >50% Based on Multiregression Analysis , 1998, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[59]  J. Wardlaw,et al.  Outcome, observer reliability, and patient preferences if CTA, MRA, or Doppler ultrasound were used, individually or together, instead of digital subtraction angiography before carotid endarterectomy , 2002, Journal of neurology, neurosurgery, and psychiatry.

[60]  P. Humphrey,et al.  Complications of cerebral angiography in patients with symptomatic carotid territory ischaemia screened by carotid ultrasound. , 1993, Journal of neurology, neurosurgery, and psychiatry.

[61]  Yan Liu,et al.  Sensitivity and specificity of color duplex ultrasound measurement in the estimation of internal carotid artery stenosis: a systematic review and meta-analysis. , 2005, Journal of vascular surgery.

[62]  B. Weder,et al.  Prediction of angiographic carotid artery stenosis indexes by colour Doppler‐assisted duplex imaging. A critical appraisal of the parameters used , 2000, European journal of neurology.

[63]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[64]  A. Lepoutre,et al.  Critical review of non- or minimally invasive methods (duplex ultrasonography, MR- and CT-angiography) for evaluating stenosis of the proximal internal carotid artery. , 2002, European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery.

[65]  M Heller,et al.  Common carotid artery bifurcation: preliminary results of CT angiography and color-coded duplex sonography compared with digital subtraction angiography. , 1997, AJR. American journal of roentgenology.

[66]  X Leclerc,et al.  Computed tomographic angiography for the evaluation of carotid artery stenosis. , 1995, Stroke.

[67]  D B Matchar,et al.  Noninvasive Carotid Artery Testing: A Meta-analytic Review , 1995, Annals of Internal Medicine.

[68]  G. Ladurner,et al.  Evaluation of the carotid bifurcation by duplex ultrasound, intravenous and intra-arterial digital subtraction angiography. , 1988, European neurology.

[69]  P. Humphrey,et al.  Variability in measurement of extracranial internal carotid artery stenosis as displayed by both digital subtraction and magnetic resonance angiography: an assessment of three caliper techniques and visual impression of stenosis. , 1996, Stroke.

[70]  A. Gholkar,et al.  The role of duplex sonography and angiography in the investigation of carotid artery disease , 1997, Neuroradiology.

[71]  J. Reed.  Meta-analysis of the reliability of noninvasive carotid studies. , 1991, Biomedical instrumentation & technology.

[72]  R. Reneman,et al.  Accurate noninvasive method to diagnose minor atherosclerotic lesions in carotid artery bulb. , 1989, Stroke.

[73]  D. Pelz,et al.  Internal Carotid Artery Stenosis Measurement: Comparison of 3D Computed Rotational Angiography and Conventional Digital Subtraction Angiography , 2004, Stroke.

[74]  F. Sardanelli,et al.  MR angiography of internal carotid arteries: breath-hold Gd-enhanced 3D fast imaging with steady-state precession versus unenhanced 2D and 3D time-of-flight techniques. , 1999, Journal of computer assisted tomography.

[75]  E Berry,et al.  The cost-effectiveness of magnetic resonance angiography for carotid artery stenosis and peripheral vascular disease: a systematic review. , 2002, Health technology assessment.

[76]  U. Salvolini,et al.  Carotid stenosis: a comparison between MR and spiral CT angiography , 1998, Neuroradiology.

[77]  J. Acker,et al.  Assessment of MR angiography versus arteriography for evaluation of cervical carotid bifurcation disease. , 1993, AJNR. American journal of neuroradiology.

[78]  Glenn B. Anderson,et al.  CT Angiography for the Detection and Characterization of Carotid Artery Bifurcation Disease , 2000, Stroke.

[79]  M. Cumming,et al.  Carotid artery stenosis: a prospective comparison of CT angiography and conventional angiography. , 1994, AJR. American journal of roentgenology.

[80]  A R Feinstein,et al.  Misguided efforts and future challenges for research on “diagnostic tests” , 2002, Journal of epidemiology and community health.