Evaluation of a diagnostic algorithm for heart disease in neonates.

OBJECTIVE--To develop, test, and validate an algorithm for diagnosing disease in neonates during an over the telephone referral to a specialist cardiac centre. DESIGN--A draft algorithm requiring only data available to a referring paediatrician was generated. This was modified in the light of a retrospective review of case records. A questionnaire to elicit all the data required by the algorithm was then generated. There followed a prospective three phase evaluation during consecutive over the telephone referrals. This consisted of (a) a conventional phase with unstructured referral consultations, (b) a phase with referrals structured around the questionnaire but independent of the algorithm, and (c) a validation phase with the algorithm (and its previous errors) available during the referral consultation. SETTING--59 paediatric centres in south east England and a central specialist paediatric cardiology unit. PATIENTS--Consecutive neonates (aged less than 31 days) referred with suspected heart disease. The retrospective review was of records of 174 neonates from 1979. In the prospective evaluation (1987-90) the conventional phase comprised 71 neonates (over 5.5 months), the structured phase 203 neonates (over 14 months), and the validation phase 195 neonates (over 12 months). MAIN OUTCOME MEASURES--Diagnostic accuracy (assigning patients to the correct diagnostic category (out of 27)), of the referring paediatrician, the specialist after the referral consultation, and the algorithm as compared with the definitive diagnosis by echocardiography at the specialist centre, and score for the appropriateness of management in transit. RESULTS--Simply structuring the consultation by questionnaire (that is, proceeding from the conventional phase to the structured phase) improved the diagnostic accuracy of both paediatricians (from 34% (24/71 cases) to 48% (97/203) correct) and specialists (from 54% (38/71 cases) to 64% (130/203) correct). The algorithm (structured phase) would have been even more accurate (78% (158/203 cases); p less than 0.01). Management scores in the structured phase were also better than in the conventional phase (80%(162/203 cases)v 58% (41/71) appropriate; p less than 0.01). Management scores would have improved to 91% appropriate (185/203; p less than 0.001) had the algorithmic diagnoses dictated management. The superiority of the algorithm was maintained but not bettered in the validation phase. CONCLUSIONS--Applying the algorithm should reduce the morbidity and mortality of neonates with critical heart disease by aiding clinicians in therapeutic decisions for in transit care.

[1]  H. Warner,et al.  A mathematical approach to medical diagnosis. Application to congenital heart disease. , 1961, JAMA.

[2]  G. Maccacaro,et al.  Computer diagnosis of congenital heart disease , 1968 .

[3]  E. Shortliffe,et al.  An analysis of physician attitudes regarding computer-based clinical consultation systems. , 1981, Computers and biomedical research, an international journal.

[4]  M. Freed,et al.  Side Effects of Therapy with Prostaglandin E1 in Infants with Critical Congenital Heart Disease , 1981, Circulation.

[5]  Jeffrey A. Stem,et al.  A computer-derived protocol to aid in the diagnosis of emergency room patients with acute chest pain. , 1982, The New England journal of medicine.

[6]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[7]  H. Sox,et al.  Clinical prediction rules. Applications and methodological standards. , 1985, The New England journal of medicine.

[8]  P Szolovits,et al.  Artificial intelligence in medicine. Where do we stand? , 1987, The New England journal of medicine.

[9]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[10]  E F Cook,et al.  A computer protocol to predict myocardial infarction in emergency department patients with chest pain. , 1988, The New England journal of medicine.

[11]  M. D. de Leval,et al.  To switch or not to switch? The Senning alternative. , 1988, Circulation.

[12]  K Bull,et al.  Combining clinical judgement and statistical data in expert systems: Over-the-telephone management decisions for critical congenital heart disease in the first month of life , 1989, International journal of clinical monitoring and computing.