Assessment of the performance of electrocardiographic computer programs with the use of a reference data base.

To allow an exchange of measurements and criteria between different electrocardiographic (ECG) computer programs, an international cooperative project has been initiated aimed at standardization of computer-derived ECG measurements. To this end an ECG reference library of 250 ECGs with selected abnormalities was established and a comprehensive reviewing scheme was devised for the visual determination of the onsets and offsets of P, QRS, and T waves. This task was performed by a group of cardiologists on highly amplified, selected complexes from the library of ECGs. With use of a modified Delphi approach, individual outlying point estimates were eliminated in four successive rounds. In this way final referee estimates were obtained that proved to be highly reproducible and precise. This reference data base was used to study measurement results obtained with nine vectorcardiographic and 10 standard 12-lead ECG analysis programs. The medians of program determinations of P, QRS, and T wave onsets and offsets were close to the final referee estimates. However, an important variability could be demonstrated between measurements from individual programs and mean differences from the referee estimates amounted to 10 msec for QRS for certain programs. In addition, the variances of all programs with respect to the referee point estimates were variable. Some programs proved to be more accurate and stable when the data from high- vs low-noise recordings were analyzed. Average Q wave durations calculated from ECGs for which programs agreed on the presence of a Q or QS wave differed by more than 8 msec in several program-to-program comparisons. Such differences may have important consequences with respect to diagnostic performance. Various factors that might explain these differences have been determined. The present study demonstrates that to allow an exchange of results and diagnostic criteria between different ECG computer programs, definitions, minimum wave requirements, and measurement procedures urgently need to be standardized.

[1]  J L Willems,et al.  A plea for common standards in computer aided ECG analysis. , 1980, Computers and biomedical research, an international journal.

[2]  H V PIPBERGER,et al.  Automatic Recognition of Electrocardiographic Waves by Digital Computer , 1961, Circulation research.

[3]  J J Bailey,et al.  A Method for Evaluating Computer Programs for Electrocardiographic Interpretation: III. Reproducibility Testing and the Sources of Program Errors , 1974, Circulation.

[4]  Chr. Zywietz,et al.  Common Standards for Quantitative Electrocardiography : The CSE Pilot Study , 1981 .

[5]  J L Talmon,et al.  Template waveform recognition applied to ECG-VCG analysis. , 1973, Computers and biomedical research, an international journal.

[6]  R. L. Simmons,et al.  Task force III: Computers in diagnostic electrocardiography , 1978 .

[7]  J L Willems,et al.  Common standards for quantitative electrocardiography. , 1985, Journal of medical engineering & technology.

[8]  P. Rautaharju.  Use and abuse of electrocardiographic classification systems in epidemiologic studies. , 1978, European journal of cardiology.

[9]  H. Pipberger,et al.  Beat to beat and observer variation of the electrocardiogram. , 1968, American heart journal.

[10]  P. W. MacFarlane,et al.  Optimization of Computer ECG Processing , 1980 .

[11]  R R Helppi,et al.  Canadian Colloquium on Computer-Assisted Interpretation of Electrocardiograms. IV. Suggested minimal performance requirements and methods of performance evaluation for computer ECG analysis programs. , 1973, Canadian Medical Association journal.