Reliability of electrocardiogram interpretation in critically ill patients*

Objective:To assess the intrarater and interrater reliability of electrocardiogram (ECG) interpretation in critically ill patients and to assess the effect of knowledge of cardiac troponin values on these reliability estimates. Design:Prospective cohort study. Setting:Fifteen-bed medical-surgical intensive care unit. Patients:Consecutive adults admitted over a 2-month period. Measurements and Results:All consecutive 12-lead ECGs were interpreted independently by two raters for the presence of myocardial ischemia or infarction and secondarily for specific ische-mic ECG abnormalities. The ECGs were first interpreted blinded to the patient’s troponin levels and reinterpreted on two separate occasions, blinded and unblinded to the troponin values. Results are reported using chance-independent agreement (phi) with associated 95% confidence intervals. For the presence of ischemia or infarction, the intrarater reliability ranged from fair to moderate (phi = 0.35 [95% confidence interval = 0.16, 0.52] and 0.59 [0.33, 0.77] for the two raters, respectively); interrater reliability was slight when blinded to troponin levels (phi = 0.18 [0.03, 0.32]) and increased to moderate when the raters were unblinded to troponin values (phi = 0.52 [0.33, 0.66], p value for the difference = .004). For specific ECG changes, the intrarater and interrater reliability were low for T-wave flattening, whereas detection of a left bundle branch block showed high reliability. Conclusions:ECG interpretation in critically ill patients for the presence of myocardial ischemia or infarction showed moderate reliability at best; however, there was high reliability for specific ECG changes. Knowledge of the patient’s troponin values increased the reliability for all studied ECG changes and resulted in a statistically significant increase in the interrater reliability for diagnosing myocardial ischemia or infarction. Additional studies assessing the appropriate methods of diagnosing myocardial ischemia and infarction and assessing the reliability of these diagnostic tests in critically ill patients are required.

[1]  A. Jaffe,et al.  Myocardial injury in critically ill patients : a frequently unrecognized complication , 1995 .

[2]  D. Massel.  Observer Variability in ECG Interpretation for Thrombolysis Eligibility: Experience and Context Matter , 2003, Journal of Thrombosis and Thrombolysis.

[3]  Hugo A. Katus,et al.  Myocardial infarction redefined--a consensus document of The Joint European Society of Cardiology/American College of Cardiology Committee for the redefinition of myocardial infarction. , 2000, European heart journal.

[4]  S. Salerno,et al.  Training and Competency Evaluation for Interpretation of 12-Lead Electrocardiograms: Recommendations from the American College of Physicians* , 2003, Annals of Internal Medicine.

[5]  R J Cook,et al.  Interobserver variation in interpreting chest radiographs for the diagnosis of acute respiratory distress syndrome. , 2000, American journal of respiratory and critical care medicine.

[6]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[7]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[8]  Arthur S Slutsky,et al.  Agreement between alternative classifications of acute respiratory distress syndrome. , 2001, American journal of respiratory and critical care medicine.

[9]  S. Salerno,et al.  Competency in Interpretation of 12-Lead Electrocardiograms: A Summary and Appraisal of Published Evidence , 2003, Annals of Internal Medicine.

[10]  W. Willett,et al.  Misinterpretation and misuse of the kappa statistic. , 1987, American journal of epidemiology.

[11]  T. Fehr,et al.  Elevation of troponin I in sepsis and septic shock , 2001, Intensive Care Medicine.

[12]  H. Joller-jemelka,et al.  Troponin as a risk factor for mortality in critically ill patients without acute coronary syndromes. , 2003, Journal of the American College of Cardiology.

[13]  J. Valty,et al.  Analysis of emergency department interpretation of electrocardiograms. , 1994, Journal of accident & emergency medicine.

[14]  Les Irwig,et al.  Accuracy of diagnostic tests read with and without clinical information: a systematic review. , 2004, JAMA.

[15]  A. M. Reid,et al.  Troponin I and myocardial injury in the ICU. , 1999, British journal of anaesthesia.

[16]  P. Dunn,et al.  The lack of effect of clinical information on electrocardiographic diagnosis of acute myocardial infarction. , 1990, Archives of Internal Medicine.

[17]  V. Farewell,et al.  Conditional inference for subject-specific and marginal agreement: Two families of agreement measures† , 1995 .

[18]  Geoffrey R. Norman,et al.  Impact of a clinical scenario on accuracy of electrocardiogram interpretation , 1999, Journal of General Internal Medicine.