Comparing the accuracy of Dutch dentists and dental students in the radiographic diagnosis of dentinal caries.

OBJECTIVES To compare the diagnostic accuracy of dental students using bitewing radiographs for the diagnosis of dentinal caries with that of general dental practitioners and to establish a bench mark for testing for improvement in diagnostic performance. METHODS Fourth year dental students (n=259) viewed bitewing radiographs of 105 proximal tooth surfaces. According to a micro-radiography "gold standard" 45 surfaces had dentine caries. The students were asked to diagnose presence and absence of dentine caries from which, under supervision, they calculated their sensitivity (TPR) and false positive rate (FPR). The students binary diagnostic data was compared with the historical data from a random sample of Dutch dentists (n=273). The Summary Receiver Operating Characteristic (SROC) curve method was used to analyse the data. The two groups were tested for differences in (a) diagnostic odds ratio and (b) the area under the SROC curve. RESULTS The students mean TPR for dentine caries diagnosis was 67.2% (s.d. 11.8%) and the FPR was 8.3% (s.d. 8.4%). The corresponding values for dentists were: TPR 54.0% (s.d. 14.1%) and FPR 3.1% (s.d. 4.5%). Significantly more dentists (85%) than students (72%, P<0.001) had a diagnostic odds ratio > or =21. The area under the SROC curve (Az) was 0.8194 for students and 0.8140 for dentists (P=0.70). CONCLUSIONS In our study (i) the students had a higher TPR but also a higher FPR than the dental practitioners, (ii) their overall performance (Az) was similar but (iii) for a clinically relevant population the dental practitioners would out-perform the students in diagnostic performance.

[1]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[3]  E. Keeler,et al.  Primer on certain elements of medical decision making. , 1975, The New England journal of medicine.

[4]  M. Downer,et al.  Optimum bitewing examination recall intervals assessed by computer simulation. , 2000, Community dental health.

[5]  P C Lambert,et al.  A Bayesian Approach to a General Regression Model for ROC Curves , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  G. Chapman,et al.  Decision Making in Health Care: Theory, Psychology, and Applications , 2003 .

[7]  H. Hintze.  Approximal Caries Prevalence in Danish Recruits and Progression of Caries in the Late Teens: A Retrospective Radiographic Study , 2000, Caries Research.

[8]  M W Kattan,et al.  Determining the Area under the ROC Curve for a Binary Diagnostic Test , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  I. Espelid.  Radiographic diagnoses and treatment decisions on approximal caries. , 1986, Community dentistry and oral epidemiology.

[10]  P. A. Mileman,et al.  Accuracy in radiographic diagnosis: Dutch practitioners and dental caries. , 1990, Journal of dentistry.

[11]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[12]  E. Kay,et al.  Restorative treatment decisions from bitewing radiographs--performance of dental epidemiologists and general dental practitioners. , 1996, Community dentistry and oral epidemiology.

[13]  M. Dozier,et al.  Systematic review in diagnostic radiology. , 2001, Dento maxillo facial radiology.

[14]  A. Firestone,et al.  The Effect of a Knowledge-based, Image Analysis and Clinical Decision Support System on Observer Performance in the Diagnosis of Approximal Caries from Radiographic Images , 1998, Caries Research.

[15]  E. Verdonschot,et al.  Factors involved in validity measurements of diagnostic tests for approximal caries--a meta-analysis. , 1995, Caries research.

[16]  N. Obuchowski.  Testing for equivalence of diagnostic tests. , 1997, AJR. American journal of roentgenology.

[17]  G. Guyatt,et al.  Users' Guides to the Medical Literature: III. How to Use an Article About a Diagnostic Test: B. What Are the Results and Will They Help Me In Caring for My Patients? , 1994 .

[18]  P. A. Mileman,et al.  The role of caries recognition: treatment decisions from bitewing radiographs. , 1996, Dento maxillo facial radiology.

[19]  The Role of Clinical “Experience” in Diagnostic Performance , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[20]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[21]  D. McClish,et al.  Combining and Comparing Area Estimates across Studies or Strata , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  B J Biggerstaff,et al.  Comparing diagnostic tests: a simple graphic using likelihood ratios. , 2000, Statistics in medicine.