Bayesian voting of multiple annotators for improved QT interval estimation

Human bias and significant intra- and inter- observer variance exist in electrocardiogram QT interval evaluation. A Bayesian approach (BA) with an informative prior, that combines measures from multiple humans or algorithms as well as contextual information (such as heart rate and signal quality) was developed for inferring the true QT length. The developed method is compared to the mean and median voting approaches by computing the root-mean-square (RMS) error between the computed QT lengths and the reference annotations provided by the 2006 PhysioNet/Computing in Cardiology Challenge. The BA with features can reduces the human RMS error of QT estimates to 6.04ms and 13.97ms for automated algorithms, out-performing the results in the Challenge of 6.67ms and 16.34ms respectively. For three annotators, the BA had a 10.7% improvement over the next best voting strategy for manual annotations, and 14.4% for automated algorithms. For large numbers of annotators, the BA estimates became approximately equal to the best-performing annotator.

[1]  Gerardo Hermosillo,et al.  Learning From Crowds , 2010, J. Mach. Learn. Res..

[2]  Borje Darpo,et al.  ICH E14: A New Regulatory Guidance on the Clinical Evaluation of QT/QTc Internal Prolongation and Proarrhythmic Potential for Non-antiarrhythmic Drugs , 2005 .

[3]  H. Koch,et al.  The PhysioNet/Computers in Cardiology Challenge 2006: QT interval measurement , 2006, 2006 Computers in Cardiology.

[4]  A. P. Dawid,et al.  Maximum Likelihood Estimation of Observer Error‐Rates Using the EM Algorithm , 1979 .

[5]  G D Clifford,et al.  Signal quality indices and data fusion for determining clinical acceptability of electrocardiograms , 2012, Physiological measurement.

[6]  Marek Malik,et al.  Errors and misconceptions in ECG measurement used for the detection of drug induced QT interval prolongation. , 2004, Journal of electrocardiology.

[7]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[8]  Ivan Dotsinsky,et al.  Clifford Gari D, Azuaje Francisco, McSharry Patrick E, Eds: Advanced Methods and Tools for ECG Analysis , 2007 .

[9]  G.D. Clifford,et al.  Model-based determination of QT intervals , 2006, 2006 Computers in Cardiology.

[10]  A. Kadish,et al.  Relation between QT and RR intervals during exercise testing in atrial fibrillation. , 1992, The American journal of cardiology.

[11]  Willis J. Tompkins,et al.  Quantitative Investigation of QRS Detection Rules Using the MIT/BIH Arrhythmia Database , 1986, IEEE Transactions on Biomedical Engineering.

[12]  Ivan Dotsinsky,et al.  Dataset of manually measured QT intervals in the electrocardiogram , 2006, Biomedical engineering online.

[13]  S. Salerno,et al.  Competency in Interpretation of 12-Lead Electrocardiograms: A Summary and Appraisal of Published Evidence , 2003, Annals of Internal Medicine.