Interobserver Reliability of Baseline Noncontrast CT Alberta Stroke Program Early CT Score for Intra-Arterial Stroke Treatment Selection

The ASPECTS has been shown to predict outcomes of early ischemic patients after intra-arterial therapy by providing semiquantitative data regarding infarction core. In this article the authors assessed the interobserver reliability of this scale in patients with proximal occlusions. CT studies in 155 patients were retrospectively analyzed by 2 independent observers. Among patients with anterior circulation proximal artery occlusions who were eligible for intra-arterial therapy, interrater reliability for ASPECTS grading was substantial across the entire scale. When using the dichotomized ASPECTS (≤ 7 versus >7) for treatment selection, agreement was only moderate, limiting its utility. In the patient cohort, approximately 25% of treatment decisions would have been affected by interrater reliability. BACKGROUND AND PURPOSE: Early ischemic changes on pretreatment NCCT quantified using ASPECTS have been demonstrated to predict outcomes after IAT. We sought to determine the interobserver reliability of ASPECTS for patients with AIS with PAO and to determine whether pretreatment ASPECTS dichotomized at 7 would demonstrate at least substantial κ agreement. MATERIALS AND METHODS: From our prospective IAT data base, we identified consecutive patients with anterior circulation PAO who underwent IAT over a 6-year period. Only those with an evaluable pretreatment NCCT were included. ASPECTS was graded independently by 2 experienced readers. Interrater agreement was assessed for total ASPECTS, dichotomized ASPECTS (≤7 versus >7), and each ASPECTS region. Statistical analysis included determination of Cohen κ coefficients and concordance correlation coefficients. PABAK coefficients were also calculated. RESULTS: One hundred fifty-five patients met our study criteria. Median pretreatment ASPECTS was 8 (interquartile range 7–9). Interrater agreement for total ASPECTS was substantial (concordance correlation coefficient = 0.77). The mean ASPECTS difference between readers was 0.2 (95% confidence interval, −2.8 to 2.4). For dichotomized ASPECTS, there was a 76.8% (119/155) observed rate of agreement, with a moderate κ = 0.53 (PABAK = 0.54). By region, agreement was worst in the internal capsule and the cortical areas, ranging from fair to moderate. After adjusting for prevalence and bias, agreement improved to substantial or near perfect in most regions. CONCLUSIONS: Interobserver reliability is substantial for total ASPECTS but is only moderate for ASPECTS dichotomized at 7. This may limit the utility of dichotomized ASPECTS for IAT selection.

[1]  A. Demchuk,et al.  The Alberta Stroke Program Early CT Score in Clinical Practice: What have We Learned? , 2009, International journal of stroke : official journal of the International Stroke Society.

[2]  Joanna M. Wardlaw,et al.  A Large Web-Based Observer Reliability Study of Early Ischaemic Signs on Computed Tomography. The Acute Cerebral CT Evaluation of Stroke Study (ACCESS) , 2010, PloS one.

[3]  Joseph P. Broderick,et al.  Tissue plasminogen activator for acute ischemic stroke. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. , 1995 .

[4]  J. Wardlaw,et al.  Early signs of brain infarction at CT: observer reliability and outcome after thrombolytic treatment--systematic review. , 2005, Radiology.

[5]  A. Demchuk,et al.  Using the baseline CT scan to select acute stroke patients for IV-IA therapy. , 2006, AJNR. American journal of neuroradiology.

[6]  A. Demchuk,et al.  Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy , 2000, The Lancet.

[7]  Ninds,et al.  Effect of Intravenous Recombinant Tissue Plasminogen Activator on Ischemic Stroke Lesion Size Measured by Computed Tomography , 2000, Stroke.

[8]  J. Carlin,et al.  Bias, prevalence and kappa. , 1993, Journal of clinical epidemiology.

[9]  A. Buchan,et al.  Selection of Acute Ischemic Stroke Patients for Intra-Arterial Thrombolysis With Pro-Urokinase by Using ASPECTS , 2003, Stroke.

[10]  A. Demchuk,et al.  Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. , 2001, AJNR. American journal of neuroradiology.

[11]  G. Donnan,et al.  Differential Prognosis of Isolated Cortical Swelling and Hypoattenuation on CT in Acute Stroke , 2007, Stroke.

[12]  S. Levine Effect of Intravenous Recombinant Tissue Plasminogen Activator on Ischemic Stroke Lesion Size Measured by Computed Tomography , 2000 .

[13]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[14]  Michael D Hill,et al.  ASPECTS reading requires training and experience. , 2003, Stroke.

[15]  A. Demchuk,et al.  Effect of Baseline CT Scan Appearance and Time to Recanalization on Clinical Outcomes in Endovascular Thrombectomy of Acute Ischemic Strokes , 2011, Stroke.

[16]  L Bozzao,et al.  Acute stroke: usefulness of early CT findings before thrombolytic therapy. , 1997, Radiology.

[17]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[18]  A. Demchuk,et al.  Interobserver Variation of ASPECTS in Real Time , 2004, Stroke.

[19]  J. Sim,et al.  The kappa statistic in reliability studies: use, interpretation, and sample size requirements. , 2005, Physical therapy.

[20]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[21]  R. Higashida,et al.  Intra-arterial Prourokinase for Acute Ischemic Stroke: The PROACT II Study: A Randomized Controlled Trial , 1999 .

[22]  J. Wardlaw Should all patients with suspected stroke have brain MRI instead of CT? , 2007, Nature Clinical Practice Cardiovascular Medicine.

[23]  P. Akins,et al.  Intra-arterial prourokinase for acute ischemic stroke. , 2000, JAMA.

[24]  Pek-Lan Khong,et al.  Hypodensity of >⅓ Middle Cerebral Artery Territory Versus Alberta Stroke Programme Early CT Score (ASPECTS): Comparison of Two Methods of Quantitative Evaluation of Early CT Changes in Hyperacute Ischemic Stroke in the Community Setting , 2003, Stroke.