Can a teaching intervention reduce interobserver variability in LVEF assessment: a quality control exercise in the echocardiography lab.

OBJECTIVES This study sought to determine whether a formalized teaching intervention could reduce the interobserver variability (IOV) in visual estimation of left ventricular ejection fraction (LVEF) within a group of sonographers and physicians with a spectrum of experience. BACKGROUND Precise and reliable echocardiographic assessment of LVEF is necessary for clinical decision-making and minimizing duplicative testing. Skill in the visual estimation of LVEF varies depending on experience and is critical for corroborating EF quantification. IOV may also lead to inconsistency if multiple readers are assessing the EF on serial exams. METHODS Fourteen cases of 2-dimensional echocardiograms were shown to 25 participants who estimated the EF based on a complete assessment of LV wall motion including parasternal, short-axis, apical, and subcostal views. The cases represented a spectrum of EF range, image quality, and clinical context. Following the initial interpretations, participants underwent a teaching intervention involving tutorial review of reference cases and group discussion of each case with determination of the EF guided by quantitative measure (biplane Simpson method). Three months after the teaching intervention, 14 new cases were shown to the 25 participants following the same methodology. RESULTS IOV was quantified before and after the teaching intervention with the use of a 3-factor, nested analysis of variance. The factors were: observer, patient, and pre- and post-intervention (time). The analysis of variance showed that the intervention reduced the IOV for the 25 readers between the pre- and post-intervention assessments (F = 2.8, p = 0.007). The IOV decreased from ± 14% EF prior to intervention to ± 8.4% EF following intervention (a 40% reduction in IOV). CONCLUSIONS In a large echocardiography laboratory with a wide range of training levels and experience, a simple, formalized teaching intervention can successfully diminish IOV of LVEF assessment. This intervention provides not only discrete quality measures, but also serves as a practical tool to document and improve quality of reporting, potentially reducing clinical inefficiencies and repeat testing.

[1]  P. Douglas Improving imaging: our professional imperative. , 2006, Journal of the American College of Cardiology.

[2]  J. Kisslo A letter from America , 1994, Heart.

[3]  John Gorcsan,et al.  Guidelines and recommendations for digital echocardiography : A report from the digital echocardiography committee of the American Society of Echocardiography , 2005 .

[4]  R. Hendel,et al.  Achieving quality in cardiovascular imaging: proceedings from the American College of Cardiology-Duke University Medical Center Think Tank on Quality in Cardiovascular Imaging. , 2006, Journal of the American College of Cardiology.

[5]  Recommendations for continuous quality improvement in echocardiography. American Society of Echocardiography. , 1995, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[6]  R. Popp,et al.  Distribution and morphologic features of coronary artery disease in cardiac allografts: an intracoronary ultrasound study. , 1995, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[7]  Pamela S Douglas,et al.  Acc/aha/ase 2003 Guideline Update for the Clinical Application of Echocardiography: Summary Article a Report of the American College of Cardiology/american Heart Association Task Force on Practice Guidelines (acc/aha/ase Committee to Update the 1997 Guidelines for the Clinical Application of Echocar , 2003 .

[8]  J. Gardin,et al.  American Society of Echocardiography recommendations for use of echocardiography in clinical trials. , 2004, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[9]  John Gorcsan,et al.  Guidelines and recommendations for digital echocardiography. , 2005, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[10]  E. Gertner,et al.  Addressing the challenges in teaching quality improvement. , 2009, The American journal of medicine.

[11]  Richard B Devereux,et al.  Recommendations for chamber quantification: a report from the American Society of Echocardiography's Guidelines and Standards Committee and the Chamber Quantification Writing Group, developed in conjunction with the European Association of Echocardiography, a branch of the European Society of Cardio , 2005, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.