The development and testing of a survey instrument for benchmarking dental plan performance: using insured patients' experiences as a gauge of dental care quality.

BACKGROUND There is no standard, nonproprietary method for providing national benchmarks of dental care quality as described by patients. The purpose of this research was to develop such a tool following guidelines of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) initiative. METHODS The authors identified domains of dental care quality via qualitative methods, including a literature review, stakeholder interviews and focus groups with beneficiaries, and they cognitively tested draft questions with patients to yield a pilot survey. Psychometric analyses of pilot data (n = 3,264) identified summary indexes and guided survey revisions. The authors used two waves of subsequent data collection (n = 4,221) to test the validity of the revised survey. RESULTS The mean response rate across three rounds of data collection was 51 percent. Statistical analysis indicated that 17 questions could be reliably collapsed into three composite measures: "Care From Dentist and Staff" (reliability = 0.89, scaling success = 100 percent); "Access to Dental Care" (reliability = 0.78, scaling success = 100 percent); and "Dental Plan Coverage/Service" (reliability = 0.84, scaling success = 100 percent). CONCLUSIONS The validity of the survey was supported in mail and Internet modes for the American English language, and the instrument was approved by the CAHPS consortium for distribution as the CAHPS Dental Plan Survey. PRACTICE IMPLICATIONS. A tool is available now for assessing dental care quality by measuring adult patients' experiences with their dental care and coverage. The authors tested this instrument only in a population with third-party coverage, however, which is a potential limitation that should be considered.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  G. Kvale,et al.  Factors related to satisfaction with dental care among 23-year olds in Norway. , 2005, Community dentistry and oral epidemiology.

[3]  A James O'Malley,et al.  Methods used to streamline the CAHPS Hospital Survey. , 2005, Health services research.

[4]  M. Chisick Satisfaction of active duty soldiers with family dental care. , 1997, Military medicine.

[5]  S. Birch,et al.  Patient Preferences and the Measurement of Utilities in the Evaluation of Dental Technologies , 2002, Journal of dental research.

[6]  I. Gasquet,et al.  Regular visitors are not good substitutes for assessment of elderly patient satisfaction with nursing home care and services. , 2003, The journals of gerontology. Series A, Biological sciences and medical sciences.

[7]  Liran Levin,et al.  Patients' satisfaction with dental esthetics. , 2007, Journal of the American Dental Association.

[8]  A. Wenzel,et al.  Patient experience of, and satisfaction with, delayed-immediate vs. delayed single-tooth implant placement. , 2004, Clinical oral implants research.

[9]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[10]  G. Forehand,et al.  A Method for Correcting Item-Total Correlations for the Effect of Relevant Item Inclusion , 1962 .

[11]  D. Locker,et al.  An assessment of sensitivity to change of the Oral Health Impact Profile in a clinical trial. , 2001, Community dentistry and oral epidemiology.

[12]  P. Glantz,et al.  Does the quality of advanced prosthetic dentistry determine patient satisfaction? , 1997, Acta odontologica Scandinavica.

[13]  C. Darby,et al.  Measuring hospital care from the patients' perspective: an overview of the CAHPS Hospital Survey development process. , 2005, Health services research.

[14]  J. Bader,et al.  A primer on outcomes in dentistry. , 1999, Journal of public health dentistry.

[15]  R. Zimmerman The Dental Appointment and Patient Behavior Differences in Patient and Practitioner Preferences, Patient Satisfaction, and Adherence , 1988, Medical care.

[16]  D. Rubin Multiple imputation for nonresponse in surveys , 1989 .

[17]  N. Castle Family satisfaction with nursing facility care. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[18]  R. Hays,et al.  Psychometric properties of the CAHPS 1.0 survey measures. Consumer Assessment of Health Plans Study. , 1999, Medical care.

[19]  J. Bader,et al.  Development of effectiveness of care and use of services measures for dental care plans. , 1999, Journal of public health dentistry.

[20]  A. Halling,et al.  Perceived oral health : changes over 5 years in one Swedish age-cohort , 2003 .

[21]  W. Marcenes,et al.  Treatment planning: Perceived inability to cope and care-seeking in patients with toothache: a qualitative study , 2000, British Dental Journal.

[22]  J. Sloan,et al.  Patients with reconstruction of craniofacial or intraoral defects: development of instruments to measure quality of life. , 2001, The International journal of oral & maxillofacial implants.

[23]  H. De Bruyn,et al.  Patient's opinion and treatment outcome of fixed rehabilitation on Brånemark implants. A 3-year follow-up study in private dental practices. , 1997, Clinical oral implants research.

[24]  Paul D Cleary,et al.  Psychometric Properties of the Consumer Assessment of Health Plans Study (CAHPS®) 2.0 Adult Core Survey , 2003 .

[25]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[26]  E J Kay,et al.  Exploring dental patients' preferred roles in treatment decision-making – a novel approach , 2003, British Dental Journal.

[27]  M. Harris,et al.  Patients' preferences for dentists' behaviors. , 1985, Journal of the American Dental Association.

[28]  Jr. Richard L. Street Patients' Satisfaction With Dentists' Communicative Style , 1989 .

[29]  C. McGrath,et al.  Patient-centred outcome measures in oral medicine: are they valid and reliable? , 2002, International journal of oral and maxillofacial surgery.