Modified National Institutes of Health Stroke Scale for Use in Stroke Clinical Trials: Prospective Reliability and Validity

Background and Purpose— To prospectively evaluate the reliability and validity of this previously developed stroke scale in an independently collected cohort. The National Institutes of Health Stroke Scale (NIHSS) has been criticized for its complexity and variability. Prior formal clinimetric analyses were used to obtain a modified version of NIHSS (mNIHSS), which retrospectively demonstrated improved reliability and validity. We sought to prospectively measure the reliability and validity of the mNIHSS. Methods— Forty-five patients with a history of stroke or intracerebral hemorrhage were evaluated at the University of California, San Diego, Stroke Center from September 2000 through March 2001. Each patient was tested by 2 NIHSS-certified neurologists using the NIHSS, mNIHSS, Barthel Index, and Modified Rankin scales. Results— There were a large percentage of high &kgr; values using the mNIHSS. Only 10 (66.67%) of 15 NIHSS &kgr; scores showed excellent agreement, whereas 10 (90.91%) of 11 mNIHSS &kgr; scores showed excellent agreement. As predicted, the mNIHSS was more reliable than the NIHSS because of the exclusion of items with low &kgr; values. With the use of correlation coefficient analysis, the mNIHSS was as valid as the NIHSS. Conclusions— This prospective study found high reliability and continued validity by using a previously developed mNIHSS. Items found to have low &kgr; values were consistent with the previously derived retrospective mNIHSS. The resulting mNIHSS scale has much higher &kgr; values. The mNIHSS showed improved agreement between examiners and was also easier to administer, having fewer and simpler items. Further prospective evaluation should assess whether the mNIHSS could be used in lieu of the NIHSS.

[1]  P D Lyden,et al.  A Modified National Institutes of Health Stroke Scale for Use in Stroke Clinical Trials: Preliminary Reliability and Validity , 2001, Stroke.

[2]  R. Sacco,et al.  Glycine antagonist in neuroprotection for patients with acute stroke: GAIN Americas: a randomized controlled trial. , 2001, JAMA.

[3]  L. Goldstein,et al.  Retrospective Assessment of Initial Stroke Severity: Comparison of the NIH Stroke Scale and the Canadian Neurological Scale , 2001, Stroke.

[4]  W. Rosamond,et al.  Use of the National Institutes of Health Stroke Scale in the emergency department setting. , 2000, Annals of emergency medicine.

[5]  L. Williams,et al.  Retrospective assessment of initial stroke severity with the NIH Stroke Scale. , 2000, Stroke.

[6]  P D Lyden,et al.  Does the National Institutes of Health Stroke Scale favor left hemisphere strokes? NINDS t-PA Stroke Study Group. , 1999, Stroke.

[7]  J. Marler,et al.  Underlying structure of the National Institutes of Health Stroke Scale: results of a factor analysis. NINDS tPA Stroke Trial Investigators. , 1999, Stroke.

[8]  J. McNeil,et al.  Interrater Reliability of the National Institutes of Health Stroke Scale: Rating by Neurologistsand N urses in a Community-Based Stroke Incidence Study , 1999, Cerebrovascular Diseases.

[9]  J. Kvedar,et al.  Role for telemedicine in acute stroke. Feasibility and reliability of remote administration of the NIH stroke scale. , 1999, Stroke.

[10]  A R Localio,et al.  Reliability and validity of estimating the NIH stroke scale score from medical records. , 1999, Stroke.

[11]  H. Adams,et al.  Antithrombotic treatment of ischemic stroke among patients with occlusion or severe stenosis of the internal carotid artery , 1999, Neurology.

[12]  J. Rudolf,et al.  Training as a prerequisite for reliable use of NIH Stroke Scale. , 1998, Stroke.

[13]  P. Lyden,et al.  Assessment scales for the evaluation of stroke patients. , 1998, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[14]  B. Tilley,et al.  Myths regarding the NINDS rt-PA Stroke Trial: setting the record straight. , 1997, Annals of emergency medicine.

[15]  G. Samsa,et al.  Reliability of the National Institutes of Health Stroke Scale. Extension to non-neurologists in the context of a clinical trial. , 1997, Stroke.

[16]  I Litvan,et al.  A reappraisal of reliability and validity studies in stroke. , 1996, Stroke.

[17]  N L Geller,et al.  Use of a global test for multiple outcomes in stroke trials with application to the National Institute of Neurological Disorders and Stroke t-PA Stroke Trial. , 1996, Stroke.

[18]  G. Murray,et al.  Comparison of neurological scales and scoring systems for acute stroke prognosis. , 1996, Stroke.

[19]  B. Tilley,et al.  A40 Analytical issues for Stroke clinical trials , 1996 .

[20]  Koroshetz Wj,et al.  Tissue plasminogen activator for acute ischemic stroke. , 1996, The New England journal of medicine.

[21]  Joseph P. Broderick,et al.  Tissue plasminogen activator for acute ischemic stroke. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. , 1995 .

[22]  T. Brott,et al.  Improved Reliability of the NIH Stroke Scale Using Video Training , 1994, Stroke.

[23]  J. Keyser,et al.  Neurological Scales in the Assessment of Cerebral Infarction , 1994 .

[24]  H. Adams,et al.  Ensuring Reliability of Outcome Measures in Multicenter Clinical Trials of Treatments for Acute Ischemic Stroke: The Program Developed for the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) , 1994, Stroke.

[25]  M. Pessin,et al.  Serial Assessment of Acute Stroke Using the NIH Stroke Scale , 1994, Stroke.

[26]  M. Limburg,et al.  A Comparison of Five Stroke Scales With Measures of Disability, Handicap, and Quality of Life , 1993, Stroke.

[27]  L. Candelise,et al.  Stroke Scores and Scales , 1992 .

[28]  L. Cyr,et al.  Measures of clinical agreement for nominal and categorical data: the kappa coefficient. , 1992, Computers in biology and medicine.

[29]  Louette R. Johnson Lutjens.  Research , 2006 .

[30]  P D Lyden,et al.  A Critical Appraisal of Stroke Evaluation and Rating Scales , 1991, Stroke.

[31]  P D Sampson,et al.  Measuring interrater reliability among multiple raters: an example of methods for nominal data. , 1990, Statistics in medicine.

[32]  J. Marler,et al.  Measurements of acute cerebral infarction: a clinical examination scale. , 1989, Stroke.

[33]  James N. Davis,et al.  Interrater reliability of the NIH stroke scale. , 1989, Archives of neurology.

[34]  V Hachinski,et al.  The Canadian Neurological Scale , 1989, Neurology.

[35]  V Hachinski,et al.  Stroke Assessment Scales: Guidelines for Development, Validation, and Reliability Assessment , 1988, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[36]  K. Asplund.  Clinimetrics in stroke research. , 1987, Stroke.

[37]  B Kirshner,et al.  A methodological framework for assessing health indices. , 1985, Journal of chronic diseases.

[38]  A. Feinstein.  An additional basic science for clinical medicine: III. The challenges of comparison and measurement. , 1983, Annals of internal medicine.

[39]  W. Grove.  Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[40]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[41]  B Jennett,et al.  Prognosis of patients with severe head injury. , 1979, Neurosurgery.

[42]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[43]  J. Meyer,et al.  Double-blind evaluation of glycerol therapy in acute cerebral infarction. , 1972, Lancet.

[44]  Gunnar B. Stickler,et al.  Prognosis , 1970 .

[45]  F. Mahoney,et al.  FUNCTIONAL EVALUATION: THE BARTHEL INDEX. , 2018, Maryland state medical journal.

[46]  F. I. Mahonery.  Functional evaluation : Barthel index , 1965 .

[47]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[48]  J. Rankin.  Cerebral Vascular Accidents in Patients over the Age of 60: II. Prognosis , 1957, Scottish medical journal.

[49]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.