Interrater reliability of Glasgow Coma Scale scores in the emergency department.

STUDY OBJECTIVE Emergency physicians often use the Glasgow Coma Scale (GCS) to help guide decisions in patient care, yet the reliability of the GCS has never been tested in a typical broad sample of emergency department (ED) patients. We determined the interrater reliability of the GCS between emergency physicians when adult patients with altered levels of consciousness are assessed. METHODS In this prospective observational study at a university Level I trauma center, we enrolled a convenience sample of ED patients older than 17 years who presented with an altered level of consciousness. Two residency-trained attending emergency physicians independently assessed and recorded the GCS score and its components (eye, verbal, and motor) in blinded fashion within a 5-minute period. Data were analyzed for interrater reliability by using standard ordinal calculations. We also created scatter plots and Bland-Altman plots for each GCS component and for the GCS score. RESULTS One hundred thirty-one patients were screened and enrolled in the study, with 15 excluded because of protocol violations. Of the 116 remaining patients, the agreement percentage for exact total GCS was 32% (tau-b=0.739; Spearman rho=0.864; Spearman rho2=75%). Agreement percentage for GCS components were eye 74% (tau-b=0.715; Spearman rho=0.757; Spearman rho2=57%), verbal 55% (tau-b=0.587; Spearman rho=0.665; Spearman rho2=44%), and motor 72% (tau-b=0.742; Spearman rho=0.808; Spearman rho2=65%). Our Spearman's analyses found that only approximately half (44% to 65%) of the observed variance could be explained by the relationship between the paired component measures. For GCS components, only 55% to 74% of paired measures were identical, and 6% to 17% of them were 2 or more points apart. CONCLUSION We found only moderate degrees of interrater agreement for the GCS and its components.

[1]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[2]  B. Jennett,et al.  Assessment of coma and impaired consciousness. A practical scale. , 1974, Lancet.

[3]  B Jennett,et al.  Prognosis of patients with severe head injury. , 1979, Neurosurgery.

[4]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[5]  L. Miller,et al.  The Glasgow Coma Scale in intensive care: a study. , 2000, Nursing in critical care.

[6]  Frank E. Harrell,et al.  Identification of Comatose Patients at High Risk for Death or Severe Disability , 1995 .

[7]  K. Nagy,et al.  The utility of head computed tomography after minimal head injury. , 1999, The Journal of trauma.

[8]  R. Knill-Jones,et al.  Observer variability in assessing the clinical features of subarachnoid hemorrhage. , 1983, Journal of neurosurgery.

[9]  M. Rué,et al.  Mortality prediction in head trauma patients: performance of Glasgow Coma Score and general severity systems. , 1998, Critical care medicine.

[10]  T. Novack,et al.  Assessment of level of consciousness following severe neurological insult. A comparison of the psychometric qualities of the Glasgow Coma Scale and the Comprehensive Level of Consciousness Scale. , 1984, Journal of neurosurgery.

[11]  C. Buechler,et al.  Variation among trauma centers' calculation of Glasgow Coma Scale score: results of a national survey. , 1998, The Journal of trauma.

[12]  Benjamin A Lipsky,et al.  Diagnosing pneumonia by physical examination: relevant or relic? , 1999, Archives of internal medicine.

[13]  M. Elliott.  Interrater reliability of the Glasgow Coma Scale. , 1996, The Journal of neuroscience nursing : journal of the American Association of Neuroscience Nurses.

[14]  W. Marget,et al.  LIPOPOLYSACCHARIDES IN CROHN'S DISEASE , 1976, The Lancet.

[15]  R. Young,et al.  Is early prediction of outcome in severe head injury possible? , 1991, Archives of surgery.

[16]  A. Lewén,et al.  Infratentorial traumatic brain hemorrhage: may outcome be predicted by initial GCS? , 2000, The Journal of trauma.

[17]  S. Norwood,et al.  A prehospital glasgow coma scale score < or = 14 accurately predicts the need for full trauma team activation and patient hospitalization after motor vehicle collisions. , 2002, The Journal of trauma.

[18]  B Jennett,et al.  Adding up the Glasgow Coma Score. , 1979, Acta neurochirurgica. Supplementum.

[19]  J. Miller,et al.  A comparison of the Glasgow Coma Scale and the Swedish Reaction Level Scale. , 1993, Brain injury.

[20]  D. Marion,et al.  Problems with initial Glasgow Coma Scale assessment caused by prehospital treatment of patients with head injuries: results of a national survey. , 1994, The Journal of trauma.

[21]  G. Rowley,et al.  Reliability and accuracy of the Glasgow Coma Scale with experienced and inexperienced users , 1991, The Lancet.

[22]  R. Knill-Jones,et al.  Observer variability in assessing impaired consciousness and coma. , 1978, Journal of neurology, neurosurgery, and psychiatry.

[23]  F. Servadei,et al.  Importance of a reliable admission Glasgow Coma Scale score for determining the need for evacuation of posttraumatic subdural hematomas: a prospective study of 65 patients. , 1998, The Journal of trauma.

[24]  R. Narayan,et al.  Enhanced specificity of prognosis in severe head injury. , 1988, Journal of neurosurgery.

[25]  W. Mower,et al.  Interrater reliability of cervical spine injury criteria in patients with blunt trauma. , 1998, Annals of emergency medicine.

[26]  R. Rimel,et al.  THE GLASGOW COMA SCALE: TO SUM OR NOT TO SUM? , 1983, The Lancet.

[27]  G. Teasdale,et al.  Defining acute mild head injury in adults: a proposal based on prognostic factors, diagnosis, and management. , 2001, Journal of neurotrauma.

[28]  E. Etchells,et al.  Does this patient have an abnormal systolic murmur? , 1997, JAMA.

[29]  F. Plum,et al.  Prognosis in nontraumatic coma. , 1981, Annals of internal medicine.

[30]  G. Teasdale,et al.  Extracranial insults and outcome in patients with acute head injury--relationship to the Glasgow Coma Scale. , 1984, Injury.

[31]  B. Jennett,et al.  Assessment and prognosis of coma after head injury , 2005, Acta Neurochirurgica.

[32]  W. Morrish,et al.  Mild head injury: a misnomer. , 1999, Brain injury.

[33]  P. Paris,et al.  Reliability of the Glasgow Coma Scale when used by emergency physicians and paramedics. , 1993, The Journal of trauma.

[34]  R. Zafonte,et al.  Penetrating head injury: A prospective study of outcomes , 2001, Neurological research.

[35]  B Jennett,et al.  Severe head injuries in three countries. , 1977, Journal of neurology, neurosurgery, and psychiatry.

[36]  A. Marmarou,et al.  Prediction tree for severely head-injured patients. , 1991, Journal of neurosurgery.

[37]  W. Hauser,et al.  Nontraumatic coma. Glasgow coma score and coma etiology as predictors of 2-week outcome. , 1990, Archives of neurology.

[38]  D. Galletly,et al.  Glasgow Coma Scale: variation in mortality among permutations of specific total scores , 2000, Intensive Care Medicine.

[39]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[40]  J. Starmark,et al.  A comparison of the Glasgow Coma Scale and the Reaction Level Scale (RLS85). , 1988, Journal of neurosurgery.

[41]  R. Ferguson,et al.  LYMPHOID CELLS IN JEJUNAL MUCOSA , 1975, The Lancet.

[42]  R. Rutledge,et al.  Field triage of trauma patients based upon the ability to follow commands: a study in 29,573 injured patients. , 1995, The Journal of trauma.

[43]  S. Ross,et al.  Efficacy of the motor component of the Glasgow Coma Scale in trauma triage. , 1998, The Journal of trauma.

[44]  D. Karras.  Statistical methodology: II. Reliability and validity assessment in study design, Part B. , 1997, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[45]  P. Lewi,et al.  PREDICTIVE VALUE OF GLASGOW COMA SCORE FOR AWAKENING AFTER OUT-OF-HOSPITAL CARDIAC ARREST , 1988, The Lancet.

[46]  J. Tesseris,et al.  A comparative study of the Reaction Level Scale (RLS 85) with Glasgow Coma Scale (GCS) and Edinburgh-2 Coma Scale (modified) (E2CS(M)) , 2005, Acta Neurochirurgica.

[47]  George A Wells,et al.  The Canadian CT Head Rule for patients with minor head injury , 2001, The Lancet.

[48]  T. Mills,et al.  Indications for computed tomography in patients with minor head injury. , 2000, The New England journal of medicine.

[49]  A. Brawanski,et al.  Comparison of clinical, radiologic, and serum marker as prognostic factors after severe head injury. , 1999, The Journal of trauma.

[50]  B Jennett,et al.  PREDICTING OUTCOME IN INDIVIDUAL PATIENTS AFTER SEVERE HEAD INJURY , 1976, The Lancet.

[51]  G. Teasdale,et al.  Glasgow Head Injury Outcome Prediction Program: an independent assessment , 1999, Journal of neurology, neurosurgery, and psychiatry.

[52]  Baruch Krauss,et al.  Can the bispectral index monitor quantify altered level of consciousness in emergency department patients? , 2003, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[53]  S. Fakhry,et al.  The conundrum of the Glasgow Coma Scale in intubated patients: a linear regression prediction of the Glasgow verbal score from the Glasgow eye and motor scores. , 1998, The Journal of trauma.

[54]  T. Sectish,et al.  Pediatric residents' clinical diagnostic accuracy of otitis media. , 2002, Pediatrics.

[55]  P. Borczuk.  Predictors of Intracranial Injury in Patients With Mild Head Trauma , 1995 .

[56]  Valerie J. Juarez,et al.  Interrater Reliability of the Glasgow Coma Scale , 1995, The Journal of neuroscience nursing : journal of the American Association of Neuroscience Nurses.

[57]  P. Gaudry,et al.  The use of Glasgow Coma Scale in poisoning. , 1993, The Journal of emergency medicine.

[58]  R. Zafonte,et al.  Relationship between Glasgow coma scale and functional outcome. , 1996, American journal of physical medicine & rehabilitation.