Interrater Reliability of the Pediatric National Institutes of Health Stroke Scale (PedNIHSS) in a Multicenter Study

Background and Purpose— Stroke is an important cause of death and disability among children. Clinical trials for childhood stroke require a valid and reliable acute clinical stroke scale. We evaluated interrater reliability (IRR) of a pediatric adaptation of the National Institutes of Health Stroke Scale. Methods— The pediatric adaptation of the National Institutes of Health Stroke Scale was developed by pediatric and adult stroke experts by modifying each item of the adult National Institutes of Health Stroke Scale for children, retaining all examination items and scoring ranges of the National Institutes of Health Stroke Scale. Children 2 to 18 years of age with acute arterial ischemic stroke were enrolled in a prospective cohort study from 15 North American sites from January 2007 to October 2009. Examiners were child neurologists certified in the adult National Institutes of Health Stroke Scale. Each subject was examined daily for 7 days or until discharge. A subset of patients at 3 sites was scored simultaneously and independently by 2 study neurologists. Results— IRR testing was performed in 25 of 113 a median of 3 days (interquartile range, 2 to 4 days) after symptom onset. Patient demographics, total initial pediatric adaptation of the National Institutes of Health Stroke Scale scores, risk factors, and infarct characteristics in the IRR subset were similar to the non-IRR subset. The 2 raters' total scores were identical in 60% and within 1 point in 84%. IRR was excellent as measured by concordance correlation coefficient of 0.97 (95% CI, 0.94 to 0.99); intraclass correlation coefficient of 0.99 (95% CI, 0.97 to 0.99); precision measured by Pearson &rgr; of 0.97; and accuracy measured by the bias correction factor of 1.0. Conclusions— There was excellent IRR of the pediatric adaptation of the National Institutes of Health Stroke Scale in a multicenter prospective cohort performed by trained child neurologists.

[1]  Steven P. Miller,et al.  Delayed Recognition of Initial Stroke in Children: Need for Increased Awareness , 2009, Pediatrics.

[2]  N. B. Lerner,et al.  Predictors of Cerebral Arteriopathy in Children With Arterial Ischemic Stroke: Results of the International Pediatric Stroke Study , 2009, Circulation.

[3]  H. Fullerton,et al.  Male Predominance in Childhood Ischemic Stroke: Findings From the International Pediatric Stroke Study , 2009, Stroke.

[4]  F. Silver,et al.  Delay to Diagnosis in Acute Pediatric Arterial Ischemic Stroke , 2009, Stroke.

[5]  Shoujun Zhao,et al.  Risk of stroke in children , 2003, Neurology.

[6]  A. Wade,et al.  Investigation of risk factors in children with arterial ischemic stroke , 2003, Annals of neurology.

[7]  N. Cox,et al.  A Note on the Concordance Correlation Coefficient , 2002 .

[8]  D. Tanné,et al.  Predictors of good outcome after intravenous tPA for acute ischemic stroke , 2001, Neurology.

[9]  G. deVeber,et al.  Neurologic Outcome in Survivors of Childhood Arterial Ischemic Stroke and Sinovenous Thrombosis , 2000, Journal of child neurology.

[10]  J. W. Lewis,et al.  A note on concordance correlation coefficient. , 2000, PDA journal of pharmaceutical science and technology.

[11]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[12]  G. Samsa,et al.  Reliability of the National Institutes of Health Stroke Scale. Extension to non-neurologists in the context of a clinical trial. , 1997, Stroke.

[13]  M. Giroud,et al.  Cerebrovascular disease in children under 16 years of age in the city of Dijon, France: a study of incidence and clinical features from 1985 to 1993. , 1995, Journal of clinical epidemiology.

[14]  T. Brott,et al.  Improved Reliability of the NIH Stroke Scale Using Video Training , 1994, Stroke.

[15]  J. Marler,et al.  Measurements of acute cerebral infarction: a clinical examination scale. , 1989, Stroke.

[16]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[17]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .