Improving the Reliability of Stroke Disability Grading in Clinical Trials and Clinical Practice: The Rankin Focused Assessment (RFA)

Background and Purpose— The modified Rankin Scale rates global disability after stroke and is the most comprehensive and widely used primary outcome measure in acute stroke trials. However, substantial interobserver variability in modified Rankin Scale scoring has been reported. This study sought to develop and validate a short, practicable structured assessment that would enhance interrater reliability. Methods— The Rankin Focused Assessment was developed by selecting and refining elements from prior instruments. The Rankin Focused Assessment takes 3 to 5 minutes to apply and provides clear, operationalized criteria to distinguish the 7 assignable global disability levels. The Rankin Focused Assessment was prospectively validated 3 months poststroke among 50 consecutive patients enrolled in the Phase 3 National Institutes of Health Field Administration of Stroke Therapy–Magnesium (FAST-MAG) Trial. Results— Among the 50 patients, mean age was 71.5 years (range, 43 to 93 years), 48% were female, and stroke subtype was hemorrhagic in 24%. At Day 90, 43 patients were alive and 7 had died. The modified Rankin Scale median was 2.0 and mean was 2.8. When pairs of 14 raters assessed all enrolled patients, the percent agreement was 94%, the weighted &kgr; was 0.99 (95% CI, 0.99 to 1.0), and the unweighted &kgr; was 0.93 (95% CI, 0.85 to 1.00). Among the 43 surviving patients, the percent agreement was 93%, the weighted &kgr; was 0.99 (0.98 to 1.0), and the unweighted &kgr; was 0.91 (0.82 to 1.00). Conclusions— The Rankin Focused Assessment yields high interrater reliability in the grading of final global disability among consecutive patients with stroke participating in a randomized clinical trial. The Rankin Focused Assessment is brief and practical for use in multicenter clinical trials and quality improvement activities.

[1]  P. Duncan,et al.  Stroke Recovery Profile and the Modified Rankin Assessment , 2001, Neuroepidemiology.

[2]  P. Bath Calculation of Sample Size for Stroke Trials Assessing Functional Outcome: Comparison of Binary and Ordinal Approaches , 2008, International journal of stroke : official journal of the International Stroke Society.

[3]  J. Saver Novel End Point Analytic Techniques and Interpreting Shifts Across the Entire Range of Outcome Scales in Acute Stroke Trials , 2007, Stroke.

[4]  Jan Potter,et al.  Reliability of the Modified Rankin Scale Across Multiple Raters: Benefits of a Structured Interview , 2005, Stroke.

[5]  J. Grotta,et al.  Number Needed to Treat to Benefit and to Harm for Intravenous Tissue Plasminogen Activator Therapy in the 3- to 4.5-Hour Window: Joint Outcome Table Analysis of the ECASS 3 Trial , 2009, Stroke.

[6]  Jamie L Banks,et al.  Outcomes Validity and Reliability of the Modified Rankin Scale: Implications for Stroke Clinical Trials: A Literature Review and Synthesis , 2007, Stroke.

[7]  U. Schulz,et al.  Improving the Assessment of Outcomes in Stroke: Use of a Structured Interview to Assign Grades on the Modified Rankin Scale , 2002, Stroke.

[8]  M. Walters,et al.  Initial Experience of a Digital Training Resource for Modified Rankin Scale Assessment in Clinical Trials , 2007, Stroke.

[9]  J. Rankin Cerebral Vascular Accidents in Patients over the Age of 60: II. Prognosis , 1957, Scottish medical journal.

[10]  Timothy W. Cooke,et al.  Improving the assessment of outcomes in stroke: use of a structured interview to assign grades on the modified Rankin Scale. , 2002, Stroke.

[11]  M. Walters,et al.  Variability in Modified Rankin Scoring Across a Large Cohort of International Observers , 2008, Stroke.

[12]  D. Wade,et al.  Outcome measures in acute stroke trials: a systematic review and some recommendations to improve practice. , 2000, Stroke.

[13]  Terence J Quinn,et al.  Exploring the Reliability of the Modified Rankin Scale , 2009, Stroke.

[14]  M. Walters,et al.  Functional Outcome Measures in Contemporary Stroke Trials , 2009, International journal of stroke : official journal of the International Stroke Society.

[15]  P. New,et al.  Critical Appraisal and Review of the Rankin Scale and Its Derivatives , 2005, Neuroepidemiology.

[16]  M. Walters,et al.  Reliability of the Modified Rankin Scale: A Systematic Review , 2009, Stroke.

[17]  J. Gornbein,et al.  Treatment effects for which shift or binary analyses are advantageous in acute stroke trials , 2009, Neurology.