A new approach to reliability assessment of dental caries examinations.

OBJECTIVES The objective of this study is to evaluate reliability of the International Caries Detection and Assessment System (ICDAS) and identify sources of disagreement among eight Kuwaiti dentists with no prior knowledge of the system. METHODS A 90-min introductory e-course was introduced followed by an examination of extracted teeth using the ICDAS coding system on the first day. Then three sessions of clinical examinations were performed. This study only used the data from the last session where 705 tooth surfaces of 10 patients were examined to assess bias in caries examination and on which codes the examiners had the highest disagreement. Compared with the gold standard, we evaluated bias of the ICDAS coding using three approaches (Bland-Altman plot, maximum kappa statistic, and Bhapkar's chi-square test). Linear weighted kappa statistics were computed to assess interexaminer reliability. RESULTS Marginal ICDAS distributions for most examiners were significantly different from that of the gold standard (bias present). The primary source of these marginal differences was misclassifying sound surfaces as noncavitated lesions. Interexaminer reliability of the 3-level ICDAS (codes 0, 1-2, and 3-6) classification ranged between 0.43 and 0.73, indicating evidence of substantial inconsistency between examiners. The primary source of examiner differences was agreeing on diagnosing noncavitated lesions. CONCLUSION This study highlights the importance of assessing both systematic and random sources of examiner agreement to correctly interpret kappa measures of reliability.

[1]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[2]  B. Eastwood,et al.  Prevalence of non-cavitated and cavitated carious lesions in a random sample of 7-9-year-old schoolchildren in Montreal, Quebec. , 1992, Community dentistry and oral epidemiology.

[3]  George J Eckert,et al.  Influence of the ICDAS e-learning program for occlusal caries detection on dental students. , 2010, Journal of dental education.

[4]  N B Pitts,et al.  The International Caries Detection and Assessment System (ICDAS): an integrated system for measuring dental caries. , 2007, Community dentistry and oral epidemiology.

[5]  N. Pitts,et al.  An Abbreviated Caries Clinical Trial Design Validated over 24 Months , 2002, Journal of dental research.

[6]  S. H. Jónsson,et al.  Caries prevalence of permanent teeth: a national survey of children in Iceland using ICDAS. , 2010, Community dentistry and oral epidemiology.

[7]  A. Ismail,et al.  Clinical diagnosis of precavitated carious lesions. , 1997, Community dentistry and oral epidemiology.

[8]  K. Ekstrand,et al.  Clinical Performance of Two Visual Scoring Systems in Detecting and Assessing Activity Status of Occlusal Caries in Primary Teeth , 2010, Caries Research.

[9]  E. Kidd,et al.  Occlusal caries: pathology, diagnosis and logical management. , 2001, Dental update.

[10]  N. Pitts,et al.  Occlusal caries detection in permanent molars according to WHO basic methods, ICDAS II and laser fluorescence measurements. , 2008, Community dentistry and oral epidemiology.

[11]  A. Cadavid,et al.  Dental caries in the primary dentition of a Colombian population according to the ICDAS criteria. , 2010, Brazilian oral research.

[12]  A. Ismail,et al.  A Longitudinal Evaluation of Fissure Sealants Applied in Dental Practices , 1995, Journal of dental research.

[13]  K. Ekstrand,et al.  Detection and activity assessment of primary coronal caries lesions: a methodologic study. , 2007, Operative dentistry.

[14]  Vitus Stachniss,et al.  Impact of Scoring Single or Multiple Occlusal Lesions on Estimates of Diagnostic Accuracy of the Visual ICDAS-II System , 2010, International journal of dentistry.

[15]  A. Ismail,et al.  Visual and Visuo-tactile Detection of Dental Caries , 2004, Journal of dental research.

[16]  E. Kidd,et al.  Relating visual and radiographic ranked scoring systems for occlusal caries detection to histological and microbiological evidence. , 2002, Operative dentistry.

[17]  A. Lussi,et al.  Performance of Fluorescence Methods, Radiographic Examination and ICDAS II on Occlusal Surfaces in vitro , 2008, Caries Research.

[18]  A. Jablonski-Momeni,et al.  Effect of Different Time Intervals between Examinations on the Reproducibility of ICDAS-II for Occlusal Caries , 2010, Caries Research.

[19]  M. Heinzel-Gutenbrunner,et al.  Reproducibility and Accuracy of the ICDAS-II for Detection of Occlusal Caries in vitro , 2008, Caries Research.

[20]  C. Deery,et al.  Validity and Reproducibility of ICDAS II in Primary Teeth , 2009, Caries Research.

[21]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[22]  A. Lussi,et al.  Performance of laser fluorescence devices, visual and radiographic examination for the detection of occlusal caries in primary molars , 2011, Clinical Oral Investigations.

[23]  N. Pitts,et al.  Effect of diagnostic threshold on the validity and reliability of epidemiological caries diagnosis using the Dundee Selectable Threshold Method for caries diagnosis (DSTM). , 2000, Community dentistry and oral epidemiology.

[24]  A. Ismail.  Reactor paper: minimal intervention techniques for dental caries. , 1996, Journal of public health dentistry.

[25]  S. Kullback,et al.  Symmetry and Marginal Homogeneity of an r×r Contingency Table , 1969 .

[26]  V. P. Bhapkar.  A Note on the Equivalence of Two Test Criteria for Hypotheses in Categorical Data , 1966 .

[27]  N. Pitts,et al.  The Effect of Varying Diagnostic Thresholds upon Clinical Caries Data for a Low Prevalence Group , 1988, Journal of dental research.

[28]  G. Eckert,et al.  Student versus faculty performance using a new visual criteria for the detection of caries on occlusal surfaces: an in vitro examination with histological validation. , 2009, Operative dentistry.

[29]  N. Pitts,et al.  Visual and Tactile Assessment of Arrested Initial Enamel Carious Lesions: An in vivo Pilot Study , 2005, Caries Research.

[30]  E. Kidd,et al.  Reproducibility and accuracy of three methods for assessment of demineralization depth of the occlusal surface: an in vitro examination. , 1997, Caries research.

[31]  M. P. Lozano,et al.  Plaque, caries level and oral hygiene habits in young patients receiving orthodontic treatment. , 2010, Community dental health.

[32]  K. Ekstrand,et al.  The Reliability and Accuracy of Two Methods for Proximal Caries Detection and Depth on Directly Visible Proximal Surfaces: An in vitro Study , 2011, Caries Research.

[33]  N B Pitts,et al.  International Consensus Workshop on Caries Clinical Trials (ICW-CCT)—Final Consensus Statements: Agreeing Where the Evidence Leads , 2004, Journal of dental research.

[34]  D. Richards.  Outcomes, what outcomes? , 2005, Evidence-Based Dentistry.

[35]  J. Lepkowski,et al.  Risk indicators for dental caries using the International Caries Detection and Assessment System (ICDAS). , 2007, Community dentistry and oral epidemiology.